-- Logs begin at Wed 2021-12-15 12:24:52 UTC, end at Wed 2021-12-15 13:23:19 UTC. -- Dec 15 12:50:31.283889 dv-cinder-813226-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 15 12:50:31.292805 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 12:50:31 2021] *** Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: nodename: dv-cinder-813226-4-iscsi Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: machine: x86_64 Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: clock source: unix Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: pcre jit disabled Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: detected number of CPU cores: 4 Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: current working directory: / Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: detected binary path: /usr/bin/uwsgi-core Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: your processes number limit is 47680 Dec 15 12:50:31.294851 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: your memory page size is 4096 bytes Dec 15 12:50:31.295503 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: detected max file descriptor number: 2048 Dec 15 12:50:31.295503 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: lock engine: pthread robust mutexes Dec 15 12:50:31.295503 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: thunder lock: enabled Dec 15 12:50:31.295503 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 15 12:50:31.295503 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 12:50:31.341367 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: Python main interpreter initialized at 0x55d116df89c0 Dec 15 12:50:31.341367 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: python threads support enabled Dec 15 12:50:31.341367 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: your server socket listen backlog is limited to 100 connections Dec 15 12:50:31.341367 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: your mercy for graceful operations on workers is 90 seconds Dec 15 12:50:31.341740 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 12:50:31.341814 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: *** Operational MODE: preforking *** Dec 15 12:50:31.342133 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: *** uWSGI is running in multiple interpreter mode *** Dec 15 12:50:31.342133 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: spawned uWSGI master process (pid: 79097) Dec 15 12:50:31.342370 dv-cinder-813226-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 15 12:50:31.343536 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: spawned uWSGI worker 1 (pid: 79109, cores: 1) Dec 15 12:50:31.343536 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: spawned uWSGI worker 2 (pid: 79110, cores: 1) Dec 15 12:50:31.343536 dv-cinder-813226-4-iscsi devstack@keystone.service[79097]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 12:50:36.688325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:50:36.688325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: from cryptography.utils import int_from_bytes Dec 15 12:50:36.689138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:50:36.689138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: from cryptography.utils import int_from_bytes Dec 15 12:50:36.692830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:50:36.692830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: from cryptography.utils import int_from_bytes Dec 15 12:50:36.693302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 12:50:36.693302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: from cryptography.utils import int_from_bytes Dec 15 12:50:36.737988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:50:36.738179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:50:36.738370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] command line args: [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:50:36.739171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:50:36.739347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ================================================================================ {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:50:36.739598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] admin_token = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.739842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] config_dir = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.740025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.740202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] config_source = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.740377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] debug = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.740571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.741723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.741723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.741868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 12:50:36.741868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 12:50:36.741991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] command line args: [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 12:50:36.742121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 12:50:36.742400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ================================================================================ {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 12:50:36.742526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_config_append = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] admin_token = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_dir = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] config_dir = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_file = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] config_source = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.742989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] debug = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.743934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_config_append = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_dir = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.744967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_file = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.745991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] publish_errors = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.746982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.747094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.747174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.747362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.747598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.747836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] standard_threads = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] use_journal = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] use_json = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.748981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] use_stderr = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.749073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.749149 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] use_syslog = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.749279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.749365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.749614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.749773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.749857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.749959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] publish_errors = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.750104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.750219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.750370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.750551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.750633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.750734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.750846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.750986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.751097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.751226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.751333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.751465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] standard_threads = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.751582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.751701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.751830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.751949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.752081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.752168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.752293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] use_journal = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.752405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.752547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] use_json = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.752623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.752697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] use_stderr = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.752845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.752923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] use_syslog = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.752998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 12:50:36.753239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.753974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.754051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.754892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.754994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.755975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.756918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.757885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.758864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759270 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.759963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.760880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.761983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762563 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.762953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.763978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.764868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.765955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.766959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.767901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.768933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.769798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.770963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.771931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.external = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.772959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.password = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] auth.token = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.773919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.774876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775365 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.775999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.external = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.776948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.password = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] auth.token = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.777981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.778985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.779950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.780921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.781892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.782879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.783885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.784020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.784149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.784281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.784407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.784545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.784673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785140 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.785920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.786969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.787972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.788876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789140 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.789976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.790981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.791920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.792859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.793957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.794950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.795979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.796910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.797993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.798962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.799915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.800928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.801600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.801685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.801852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.801938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.802084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.802197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.802359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.802596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.802791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.802891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.803868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.804969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.805934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.806978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] role.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] role.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.807946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.808914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.809892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.810893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] role.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] role.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.811965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.812060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.812211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.812302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.812459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.812541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.813895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.814921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.815965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.816044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.816211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.816290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.816446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.816526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.816731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.817438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.817524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.817596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.817771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.817852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.818851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.819966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.connection = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.820973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821778 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.821933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.822927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.823966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.824897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.connection = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.825052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.825138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.825212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:50:36.825355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.825597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.825842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.826081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.826349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.826590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.826831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.827120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.827361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.827611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.827850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.828102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.828347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.828594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.828853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.829117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.829359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 12:50:36.829552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 12:50:36.854296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.854519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.854740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.855924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.856160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.856390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.863454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.865657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.894333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.894554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.895831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.896072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.947453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.948022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.997828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.998001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.998085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:36.998246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.066063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.066253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.066353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.066466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.066549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.067884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.091487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.091617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.091714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.091796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.091939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.092899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.093057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.104814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.105067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.118186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.118438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.118682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.118767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.118905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.118989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119207 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.119998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79109) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 15 12:50:37.137410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.137619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 12:50:37.137917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.138024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.138126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 12:50:37.138228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 12:50:37.138424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.138505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.138653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 15 12:50:37.138748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.138913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.138994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.139161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.139240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.139410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.139655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.150907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.151094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.159017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.159251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.163080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.163253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.163362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.163522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.163641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.163794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.163922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.164994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.165871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.192699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.192797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.194350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.194585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.194669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.194853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.199881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.200036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.201849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.202025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.202154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.202334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.209540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.209672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.209821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.209951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.214314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.214405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.214605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.214742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.214874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.214968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.215937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.216017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.216199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.216279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.235414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.235617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.235702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.235886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.240336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.240803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.243977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.244376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.244470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.244797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.249381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.249754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.252996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.253881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.257226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.257517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.257801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.258865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.259142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.259424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.277903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.278200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.278396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.278497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.278670 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.278752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.278926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.279179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.287325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.287718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.289027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.289302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.289412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.289678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.292552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.292804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.292887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.293928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.307187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.307368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.307457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.307635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.307719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.307904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.308901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.309077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.327376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.329325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.330653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.332600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.334027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.335790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.335885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.337446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.337529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.337743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.338052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.339175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.339446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.339717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.345386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.346900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.347064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.349006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.350863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.351152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.351545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.351815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.352181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.352479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.352874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.353208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.361087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.361375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.361660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.362174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.362450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.362720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.369664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.369936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.370235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.370523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.370616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79109) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 15 12:50:37.370784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.370865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.371948 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.372831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.373013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.373111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.373274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.373355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.373538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.373804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.374054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79109) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 15 12:50:37.412515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d116df89c0 pid: 79109 (default app) Dec 15 12:50:37.412699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d116df89c0 pid: 79110 (default app) Dec 15 12:50:37.415949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1892a7-0989-4eff-a4a3-811115485404 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:37.416234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1892a7-0989-4eff-a4a3-811115485404 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:37.416505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1892a7-0989-4eff-a4a3-811115485404 None None] PATH_INFO: `/v3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:37.420706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Wed Dec 15 12:50:37 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:45.418833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914f27-ad93-4670-bf98-45c4a73e31ff None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:45.419350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914f27-ad93-4670-bf98-45c4a73e31ff None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:45.419453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af914f27-ad93-4670-bf98-45c4a73e31ff None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:45.424394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:45 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:45.430097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:45.430486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:45.430676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:45.462252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG oslo_db.sqlalchemy.engines [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:50:45.649609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG passlib.handlers.bcrypt [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79109) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 12:50:45.650029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG passlib.handlers.bcrypt [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79109) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 12:50:45.704407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:45.705924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:45.831919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:45.994545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af914f27-ad93-4670-bf98-45c4a73e31ff None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:46.029371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG oslo_db.sqlalchemy.engines [None req-af914f27-ad93-4670-bf98-45c4a73e31ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 12:50:46.158268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af914f27-ad93-4670-bf98-45c4a73e31ff None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:46.163259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:46.163902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:46.164180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:46.164452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:46.172301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:46.224492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 12:50:46.224827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5d59-72bc-4f09-9f3d-129384cf10b7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:46.233964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:50:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:50:46.240546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:46.254918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93523db-2fe2-4b85-81b2-ddc945a54ba3 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:46.259162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:46.260265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:46.260547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:46.260818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] PATH_INFO: `/v3/projects/ce52653451e74d3f9f778f9e368425dc` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:46.262342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce52653451e74d3f9f778f9e368425dc)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:46.314344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 15 12:50:46.314690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c589b-f452-4367-a150-3b8b474aa358 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:46.319866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:50:46 2021] GET /identity/v3/projects/ce52653451e74d3f9f778f9e368425dc => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:48.684078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa135f7-500f-4fb9-9f34-52b4cba49523 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:48.684629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa135f7-500f-4fb9-9f34-52b4cba49523 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:48.684629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa135f7-500f-4fb9-9f34-52b4cba49523 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:48.689218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:48 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:50:48.695790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:48.696193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:48.696337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:48.714446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:48.715956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:48.723621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:48.746924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa135f7-500f-4fb9-9f34-52b4cba49523 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:48.759744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa135f7-500f-4fb9-9f34-52b4cba49523 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:48.764054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973b7a4-3fe8-416f-b76d-b15fa42e0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:48.764717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973b7a4-3fe8-416f-b76d-b15fa42e0624 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:48.765025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973b7a4-3fe8-416f-b76d-b15fa42e0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:48.765329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973b7a4-3fe8-416f-b76d-b15fa42e0624 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:48.773440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973b7a4-3fe8-416f-b76d-b15fa42e0624 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:48.775296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973b7a4-3fe8-416f-b76d-b15fa42e0624 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:48.784990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:50:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:50:48.792614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:48.806796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c9ba-feb6-4e4b-99e8-e9376b697d6c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:48.813236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00f199-8734-47ea-bc98-28289b8a423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:48.814406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f199-8734-47ea-bc98-28289b8a423c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:48.814690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f199-8734-47ea-bc98-28289b8a423c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:48.814963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00f199-8734-47ea-bc98-28289b8a423c admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:48.816383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00f199-8734-47ea-bc98-28289b8a423c admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:48.818886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00f199-8734-47ea-bc98-28289b8a423c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:48.820476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:50:48 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:51.217597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0300a-6943-4bdd-80da-053fa56b8331 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.218174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0300a-6943-4bdd-80da-053fa56b8331 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.218174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0300a-6943-4bdd-80da-053fa56b8331 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.219924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:50:51.225742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.226132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.226434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.235916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c476-37f5-4990-9424-2a559613b203 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.236200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c476-37f5-4990-9424-2a559613b203 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.236476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c476-37f5-4990-9424-2a559613b203 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.238182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:50:51.244019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.244306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.244528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:51.244629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.245697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:51.253238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:51.277176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.284871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG passlib.handlers.bcrypt [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79110) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 15 12:50:51.286087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG passlib.handlers.bcrypt [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79110) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 15 12:50:51.286655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14a451-aae0-4427-9d25-8a5f0820d1af None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.290989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.291750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.292028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.292299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.305330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:50:51.312057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:50:51.313179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 7/13] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:50:51.319011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.327809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1971d-3b5b-46d8-bb43-037a0d3a34cd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.332008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:51.332123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.332621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.332898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.333166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.333619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:51.334206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:50:51.334509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:51.336273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:51.336273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:50:51.336273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:50:51.337152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:51.350973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 8/14] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:51.356020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:50:51.356532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.366355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b4cfd-9344-49fb-adf8-ea59189b6239 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.370694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.371512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.371791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.372062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.373260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:51.375095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:51.376619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 9/16] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:51.382090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.382311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.391136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f100de-4d4b-4722-a554-03ea1fd8ee5c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.391636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715b258-e577-4045-a6b0-3df3a3b26e33 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.395410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.395960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.396073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.396257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.396527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.397062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.397345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.397620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.399129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:51.400880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:51.402458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:51.404451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:51.406197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:51.408273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.415506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:50:51.417989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ad78-dd67-4df2-8b72-db4d68cd66ba admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.421082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:51.422619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.423219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.423499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.423773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.424599 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.domain.id=default, user.id=3ad517a276964868864b69d91a8b9aea) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:50:51.424904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:51.427185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:51.427185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:50:51.427185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:50:51.428337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2032-f328-4b51-9dbe-b235adf473e2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:51.429702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdde70-8a54-47b2-be9c-8a95598df39e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:51.433969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275b2d-0583-47d8-9d14-d2f13da2a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:51.435014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275b2d-0583-47d8-9d14-d2f13da2a993 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:51.435295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275b2d-0583-47d8-9d14-d2f13da2a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:51.435558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275b2d-0583-47d8-9d14-d2f13da2a993 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:51.436711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66275b2d-0583-47d8-9d14-d2f13da2a993 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:51.437011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1343 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/role_assignments?user.id=3ad517a276964868864b69d91a8b9aea&scope.domain.id=default&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:51.438397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66275b2d-0583-47d8-9d14-d2f13da2a993 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:51.439918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:54.525168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56397f25-7963-41ac-9e69-e8f60dc322d8 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.526191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56397f25-7963-41ac-9e69-e8f60dc322d8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.526645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56397f25-7963-41ac-9e69-e8f60dc322d8 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.528609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:54.534579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da899e-f8ee-4b14-99ae-45fca1170f9b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.536015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da899e-f8ee-4b14-99ae-45fca1170f9b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.536518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da899e-f8ee-4b14-99ae-45fca1170f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.576304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff6c7-8ad6-4b51-b442-d9a0c8b6903d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.576924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff6c7-8ad6-4b51-b442-d9a0c8b6903d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.577396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff6c7-8ad6-4b51-b442-d9a0c8b6903d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.581051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:54.587303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.587972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.588440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.631636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:54.632919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:54.651074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:54.696195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:54.699234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-92da899e-f8ee-4b14-99ae-45fca1170f9b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:54.700458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-92da899e-f8ee-4b14-99ae-45fca1170f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:54.705775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85b19f-54f5-47e1-bb8f-d9e213692035 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:54.711201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:54.711885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.712170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.712447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.712754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:54.713226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:54.714080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235887-be8b-42e0-88fc-2aff80e8eca5 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.714391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235887-be8b-42e0-88fc-2aff80e8eca5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.714669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95235887-be8b-42e0-88fc-2aff80e8eca5 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.716762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 13/25] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:54.718421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:54.718421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:50:54.718421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:50:54.719406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:54.739012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.739347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.739566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.781008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:54.782179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:54.791359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 14/26] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 12:50:54.792225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:54.817522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458d18a-5bae-467f-a309-18ee72f518ee None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:54.828224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:54.829019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.829294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.829562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.844986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:54.847016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:54.867085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-104ccf37-2a7a-4f93-988e-d3de818619fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:50:54.868931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 15/27] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:50:54.870411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b85dad-2037-4878-9633-d90c7659f7e7 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.870701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b85dad-2037-4878-9633-d90c7659f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.870974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b85dad-2037-4878-9633-d90c7659f7e7 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.873533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 16/28] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:54.879733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b85dad-2037-4878-9633-d90c7659f7e7 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:54.893050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b85dad-2037-4878-9633-d90c7659f7e7 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:54.897814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:54.898543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:54.898822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:54.899090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:54.899867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:54.900901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:54.900901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:50:54.900901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:50:54.901826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610c3db-6770-442a-920a-47d3507ec176 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:54.974987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 13/29] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 12:50:54 2021] POST /identity/v3/roles => generated 219 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:50:54.976010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.002307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eff737-5a48-4ad0-bf58-b787845ac1e1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.009946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.010683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.010972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.011252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.012020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:50:55.012329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.013561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:55.013561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:50:55.013561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:50:55.014523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.029633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 17/30] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 12:50:54 2021] POST /identity/v3/roles => generated 225 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:50:55.031304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.031564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.031803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.064897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 14/31] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:50:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:55.070667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.079385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:55.081013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:55.087581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3fd8-3ea9-4847-a4bf-c5f18e3659b8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.098947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.099642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.099931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.100210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.101074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.102167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:55.102167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:50:55.102167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:50:55.103450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.115580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 18/32] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:55.153942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.164700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00dd4-5046-431b-9499-7ea36960e944 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.166219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 15/33] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:50:55 2021] POST /identity/v3/projects => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:50:55.234383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.235639 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.235815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.236135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.249275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:50:55.257256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:50:55.258821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 19/34] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:50:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:50:55.264977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.277551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e1f7c-1144-433b-a07b-167ce245b982 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.282588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.283275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.283561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.283839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.284661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:50:55.284967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.286642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:55.286642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:50:55.286642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:50:55.287684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf4ff1-0c7a-4ce8-b5f6-4f0cebe884cc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.304435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 16/35] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:50:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:55.310780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.322623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8e890-f1c3-4e3a-bd9e-9c8cab1b3975 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.328391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.329778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.330295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.330575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.332726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.334910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.336737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 20/36] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:50:55 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:55.343556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad828b-f10e-42c0-a248-60f647c4e4f2 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.343835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad828b-f10e-42c0-a248-60f647c4e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.344113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad828b-f10e-42c0-a248-60f647c4e4f2 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.346313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 17/37] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:55.347433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.355813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.356102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.356374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.359104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b51b-0045-457e-9c2d-9066c129c6c1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.364493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.365290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.365567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.365837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.367076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.368997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.370873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 21/38] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:55.378691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.390561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d27ed1-cedc-45ba-a2c0-e425fa050da7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.394939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.395903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.396253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.396434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] PATH_INFO: `/v3/domains/default/users/3ad517a276964868864b69d91a8b9aea/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.398646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3ad517a276964868864b69d91a8b9aea, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.399276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:55.399828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:55.399828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:50:55.399828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:50:55.400869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:55.401944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabee1f8-8e4b-45e5-93ce-65504c0b04ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.420407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Dec 15 12:50:55.423160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 22/40] 10.222.0.57 () {58 vars in 1382 bytes} [Wed Dec 15 12:50:55 2021] PUT /identity/v3/domains/default/users/3ad517a276964868864b69d91a8b9aea/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:50:55.445190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:55.455512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dee6c-ae77-47fa-b7c4-c9c4138a1c4b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:55.550060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043a4d-8b6a-433f-8bc0-20844d567e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:55.551616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043a4d-8b6a-433f-8bc0-20844d567e61 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:55.552213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043a4d-8b6a-433f-8bc0-20844d567e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:55.552693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043a4d-8b6a-433f-8bc0-20844d567e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:55.553737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043a4d-8b6a-433f-8bc0-20844d567e61 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:55.555739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043a4d-8b6a-433f-8bc0-20844d567e61 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:55.575619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 19/41] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 12:50:55 2021] POST /identity/v3/roles => generated 223 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:50:56.141247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601e58-234d-4416-ad19-5fb773fe19b6 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:56.141737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601e58-234d-4416-ad19-5fb773fe19b6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:56.141901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601e58-234d-4416-ad19-5fb773fe19b6 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:56.143698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 23/42] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:56.149948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:56.150266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:56.150544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:56.168434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:56.169622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:56.178117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 20/43] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:56.201930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601e58-234d-4416-ad19-5fb773fe19b6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:56.214279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601e58-234d-4416-ad19-5fb773fe19b6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:56.218603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027269a-11f0-411d-ada1-2ac9fa8d1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:56.219387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027269a-11f0-411d-ada1-2ac9fa8d1e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:56.219661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027269a-11f0-411d-ada1-2ac9fa8d1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:56.219930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027269a-11f0-411d-ada1-2ac9fa8d1e8c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:56.221111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027269a-11f0-411d-ada1-2ac9fa8d1e8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:56.223492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027269a-11f0-411d-ada1-2ac9fa8d1e8c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:56.225219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 24/44] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:56.231059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:56.240090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f77309-694a-4e8a-b087-90224fac7310 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:56.244495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5061b-28ba-47a3-b7cb-6640db8e242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:56.245146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5061b-28ba-47a3-b7cb-6640db8e242f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:56.245429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5061b-28ba-47a3-b7cb-6640db8e242f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:56.245704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5061b-28ba-47a3-b7cb-6640db8e242f admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:56.246469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5061b-28ba-47a3-b7cb-6640db8e242f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:56.248408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5061b-28ba-47a3-b7cb-6640db8e242f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:56.272965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 21/45] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:50:56 2021] POST /identity/v3/projects => generated 312 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:50:57.844015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e5c9-177f-4ade-b6fc-8b12a85119c9 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:57.844486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e5c9-177f-4ade-b6fc-8b12a85119c9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:57.844714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e5c9-177f-4ade-b6fc-8b12a85119c9 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:57.846638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 25/46] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:57.852908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:57.853345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:57.853462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:57.871170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:57.872345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:57.926228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 22/47] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:57.950738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e5c9-177f-4ade-b6fc-8b12a85119c9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:57.962563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e5c9-177f-4ade-b6fc-8b12a85119c9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:57.966679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:57.967443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:57.967721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:57.967993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:57.978041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:50:57.984691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:50:57.985827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 26/48] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:50:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:50:57.992296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:58.001108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c28b1-1770-4c36-a2f2-4dbea39ce25f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:58.006097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:58.006773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.007052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.007321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.008084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:50:58.008387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:58.010014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:58.018006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 23/49] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:50:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:58.023980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:58.034518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931cc5e-5bf6-46d8-8385-1eef6c57e72f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:58.039327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:58.040158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.040497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.040776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.041969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:58.043795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:58.045354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 27/50] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:50:58 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:58.051134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:58.060564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907568c-ab81-4e6d-bcfa-635ae08283a8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:58.064902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49929087-9a96-4940-b91c-35271453a810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:58.065617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929087-9a96-4940-b91c-35271453a810 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.065900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929087-9a96-4940-b91c-35271453a810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.066198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49929087-9a96-4940-b91c-35271453a810 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.067902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49929087-9a96-4940-b91c-35271453a810 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:58.069602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49929087-9a96-4940-b91c-35271453a810 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:58.071179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 24/51] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:58.077061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:58.086697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714a019-dc74-4e3b-97a9-66e71780588d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:58.091087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:58.091716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.092001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.092277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.093128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.domain.id=default, user.id=3ad517a276964868864b69d91a8b9aea) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:50:58.093436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:58.094472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:58.094472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:50:58.094472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:50:58.095620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01810b2-728e-4285-ba63-2f60d0cb6f9c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:58.104325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 28/52] 10.222.0.57 () {56 vars in 1343 bytes} [Wed Dec 15 12:50:58 2021] GET /identity/v3/role_assignments?user.id=3ad517a276964868864b69d91a8b9aea&scope.domain.id=default&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 530 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:50:58.611616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e3707-61b9-4e92-bed4-844014068ff5 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.611898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e3707-61b9-4e92-bed4-844014068ff5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.612172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e3707-61b9-4e92-bed4-844014068ff5 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.614499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 25/53] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:50:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:50:58.620106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.620391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.620695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.638407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:50:58.639581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:50:58.649223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 29/54] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:50:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:50:58.672802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e3707-61b9-4e92-bed4-844014068ff5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:58.685129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e3707-61b9-4e92-bed4-844014068ff5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:58.689291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcba80c-797a-4b0d-a90c-0b521b6e8d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:58.690054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcba80c-797a-4b0d-a90c-0b521b6e8d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.690358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcba80c-797a-4b0d-a90c-0b521b6e8d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.690630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcba80c-797a-4b0d-a90c-0b521b6e8d71 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.692405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcba80c-797a-4b0d-a90c-0b521b6e8d71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:58.694093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcba80c-797a-4b0d-a90c-0b521b6e8d71 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:58.695654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 26/55] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:50:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:50:58.701093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:50:58.709830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dd461-0901-4e4f-8d72-a00701fb785a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:50:58.714176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:50:58.714818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:50:58.715103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:50:58.715380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:50:58.716102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:50:58.717116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:50:58.717116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:50:58.717116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:50:58.718347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb99c3f-cdc2-4738-84eb-b3e3220f1ec3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:50:58.744555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 30/56] 10.222.0.57 () {60 vars in 1161 bytes} [Wed Dec 15 12:50:58 2021] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:01.065775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d34de-501c-432a-b4bf-cb676e352793 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:01.066287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d34de-501c-432a-b4bf-cb676e352793 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:01.066287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d34de-501c-432a-b4bf-cb676e352793 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:01.068226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 27/57] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:01.073886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:01.074305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:01.074474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:01.091741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:01.092923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:01.146805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 31/58] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:01.171512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d34de-501c-432a-b4bf-cb676e352793 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:01.184259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d34de-501c-432a-b4bf-cb676e352793 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:01.188498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d23dbf-455e-4c83-9bc0-894be361fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:01.189270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d23dbf-455e-4c83-9bc0-894be361fdff admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:01.189554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d23dbf-455e-4c83-9bc0-894be361fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:01.189831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d23dbf-455e-4c83-9bc0-894be361fdff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:01.191045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d23dbf-455e-4c83-9bc0-894be361fdff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:01.192760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d23dbf-455e-4c83-9bc0-894be361fdff admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:01.194350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 28/59] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:01 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:01.199844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:01.208469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c6dfb-cd19-48aa-8dc0-2a85b4a798b9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:01.212796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:01.213441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:01.213725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:01.214004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:01.214767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:01.215775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:01.215775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:01.215775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:01.216993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdc829-9678-44d8-a79c-a4c638708392 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:01.241906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 32/60] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:01 2021] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:04.807147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23602df0-b371-4384-a895-f5da8544532b None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:04.813170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23602df0-b371-4384-a895-f5da8544532b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:04.813652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23602df0-b371-4384-a895-f5da8544532b None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:04.817379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 29/61] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:04 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:04.828161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:04.828700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:04.828700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:04.856351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558af84-1213-4d42-baef-262f4d548a84 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:04.856628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558af84-1213-4d42-baef-262f4d548a84 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:04.857067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558af84-1213-4d42-baef-262f4d548a84 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:04.859129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 30/62] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:04.864963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:04.865403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:04.865818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:04.871563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:04.881712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:04.889090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:04.890219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:04.898794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 33/63] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:04.909624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 31/64] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:04.942630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:04.948540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:04.959788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df54e6-c2e5-4cc2-ab89-a882a29cdc1b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:04.966348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c0adc-b21a-4a54-b852-efd82bca8b17 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:04.968943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994738-fde2-464c-974f-04aa7664e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:04.969766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994738-fde2-464c-974f-04aa7664e524 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:04.970045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994738-fde2-464c-974f-04aa7664e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:04.970340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994738-fde2-464c-974f-04aa7664e524 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:04.978867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:04.979666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:04.979943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:04.980210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:04.986694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49994738-fde2-464c-974f-04aa7664e524 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:04.992704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:04.995009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-49994738-fde2-464c-974f-04aa7664e524 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:04.996440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 34/65] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:05.001665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:05.003229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec30e1-cfae-4150-bc88-710bb5b81b59 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.004266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec30e1-cfae-4150-bc88-710bb5b81b59 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.004742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec30e1-cfae-4150-bc88-710bb5b81b59 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.006245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 32/66] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:05.007051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 35/67] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:05.007505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.013004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.013288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.013565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.021203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f6bd5-c7b1-442e-9d62-04f4d3da477f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.025947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.026850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.027309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.027783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.028721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.029199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.031052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.034023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:05.035568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:05.041796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 33/68] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.042953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.049993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 36/69] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:05.051160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.062052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3aaec7-f220-42f3-ad2f-b99f21d1ec81 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.064978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4fc21-c687-48b5-9715-22f66c51a3c6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.071852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.073477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.074436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.075158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.075711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.076490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.076794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.078454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.079404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.080129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.080604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.088158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 34/70] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.089180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.099715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.100149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e191a-1093-468d-bc82-5deb762747ef admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.102371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.104649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.105640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.106073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.106494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.109361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 37/71] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.110480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.118537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:05.120885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc764-701b-4a44-86c7-1fce1da3c58b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.125546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.126566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:05.126866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.127323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.127791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.128317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 35/72] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:05.129398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.134269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.136531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.138885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 38/73] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.139835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.140585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a613f1a-b812-49c6-9769-d065e9d1f58d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.146250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.147059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.147493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.147905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.155481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef54da-ec3e-4821-8a0a-b99f0cd9e286 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.156182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.158627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.160713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.161615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.162099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.162603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.163571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.164068 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.165853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.168676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 36/74] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:05.169668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.179423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b734310-5af7-4826-a6ed-8b831a80d083 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.184145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.184595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 39/75] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.185145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.185569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.185677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.186202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.194685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.196492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411f63f-0673-46f2-a747-6e1d95ed1026 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.196782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.201162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.202258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.202721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.203167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.204548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.207379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.207833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 37/76] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:05.208762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.214373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 40/77] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.215325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.217966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aecf20-1f42-498f-bf2e-d35d4b3a1b92 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.223251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.224251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.224672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.225082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.226709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.228653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.230728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 38/78] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.231666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.236535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106a11c-260e-476a-af24-695b9e13b943 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.242247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.243043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f678f3a-489b-4e25-b4a9-2d740e310c51 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.243508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.243964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.244377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.245755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.247646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.248269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.248371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.248553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.248833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.249681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] RBAC: Adding query filter params (role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=f027b96ef04e479d8f3b6863f6c94e6c) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.249987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.255955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 41/79] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.256077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435e6a3-ba1f-4255-b183-99f8147dfbde admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.256170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.258087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 39/80] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/role_assignments?user.id=f027b96ef04e479d8f3b6863f6c94e6c&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=fc97b407668046f9b05b539f70740d3d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.259475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027f4a-ed49-4409-ab50-169295dfacc0 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.259766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027f4a-ed49-4409-ab50-169295dfacc0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.260043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9027f4a-ed49-4409-ab50-169295dfacc0 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.261659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 40/81] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:05.262585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9027f4a-ed49-4409-ab50-169295dfacc0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.268569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10de5-bce2-4906-9661-429ee0660371 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.274114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.275353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.275775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.276188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.279904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9027f4a-ed49-4409-ab50-169295dfacc0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.284572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.286388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.286846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.287305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.287946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.288526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=f027b96ef04e479d8f3b6863f6c94e6c) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.289023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.289977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.291337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c3c33-e032-4dc5-8abe-5953be71a9ea admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.297858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 41/82] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/role_assignments?user.id=f027b96ef04e479d8f3b6863f6c94e6c&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.299680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.300164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.300349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 42/83] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:05.300816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.306076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.315533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b12072-fe04-4cd8-8d13-fa920a544c41 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.320253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:05.320779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.321629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:05.322067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.322586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.323079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.324665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.327176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.329231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 43/84] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:05.329779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 42/85] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:05.335952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.346068 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42bb6-e203-41e3-a723-70f4f764013d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.351080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.352059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.352545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.353036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.354570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.355154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=3ad517a276964868864b69d91a8b9aea) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.355482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.357416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed71ea6b-8b33-48cf-804e-5147ba470f22 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.364637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 44/86] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/role_assignments?user.id=3ad517a276964868864b69d91a8b9aea&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:05.365807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ca2d4-4b8f-4dc8-9a63-786512cdccb9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.374495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.375643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.375920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.376295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df157312-ab4e-4a3f-9ba7-08672d1b3611 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.376488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.376608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df157312-ab4e-4a3f-9ba7-08672d1b3611 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.376857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df157312-ab4e-4a3f-9ba7-08672d1b3611 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.379655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 45/87] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:05.386342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.386950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.387406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.393747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:05.401242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:05.402831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 43/88] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:05.407554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:05.409220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:05.409408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.417895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 46/89] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:05.430542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bcc68-a187-4f25-bcdd-a15c1f81b82c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.444214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.444920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.445209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.445493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.446382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.446698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.448439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.468781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 44/90] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:05.475233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.476301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.486627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab9abf-3c6b-4712-a42d-3580492ef851 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.492482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014251-c215-4bcd-b1d1-fe96a1ce63ef admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.493751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.494957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.495582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.496059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.497748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.500367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.502679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 47/91] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.504718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.505540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.505826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.506104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.509640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.511114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.512929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.514774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 45/92] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:05.520899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.521625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fb38-6afd-4e21-879b-dc195567e145 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.526896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.527947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.528449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.528927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.536481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e718546-6357-44d7-92c3-5322e622d6fb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.542197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.545610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.552837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.553948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.554462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.554931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.555896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.557228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:05.557228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:51:05.557228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:51:05.558953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.561421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 48/93] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:05.567914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.577106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf59e8e-9c32-427e-a823-ba763f0d4929 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.583501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b6b82-5b99-431b-92e2-d9e58f39d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.584410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6b82-5b99-431b-92e2-d9e58f39d816 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.584807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6b82-5b99-431b-92e2-d9e58f39d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.585016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b6b82-5b99-431b-92e2-d9e58f39d816 admin admin] PATH_INFO: `/v3/projects/435c131081f646a0b7b7c5b3710fa26c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.586465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6b82-5b99-431b-92e2-d9e58f39d816 admin admin] RBAC: Authorizing `identity:get_project(project_id=435c131081f646a0b7b7c5b3710fa26c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.588672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b6b82-5b99-431b-92e2-d9e58f39d816 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.591855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 46/95] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:05 2021] POST /identity/v3/users => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:05.594275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 49/95] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/projects/435c131081f646a0b7b7c5b3710fa26c => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:05.611183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:05.623192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d0d93-256d-4810-8cb2-70f6754762a6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:05.631941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:05.632619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:05.632906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:05.633183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:05.634071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=435c131081f646a0b7b7c5b3710fa26c, user.id=f027b96ef04e479d8f3b6863f6c94e6c) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:05.634514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:05.636501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dccf2-1c55-4834-8b19-62543ad87421 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:05.642914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 47/96] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:05 2021] GET /identity/v3/role_assignments?user.id=f027b96ef04e479d8f3b6863f6c94e6c&scope.project.id=435c131081f646a0b7b7c5b3710fa26c&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.017525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe744-596c-4f1b-afeb-655f1578169b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.018602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe744-596c-4f1b-afeb-655f1578169b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.019120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebe744-596c-4f1b-afeb-655f1578169b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.021334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 50/97] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:08.027646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd4c0-a5ae-4f15-90d0-25175382526c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.028510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd4c0-a5ae-4f15-90d0-25175382526c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.029010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd4c0-a5ae-4f15-90d0-25175382526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.049204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c5cdd4c0-a5ae-4f15-90d0-25175382526c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:08.051444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c5cdd4c0-a5ae-4f15-90d0-25175382526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:08.068654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 48/98] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:08.106019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe744-596c-4f1b-afeb-655f1578169b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.117999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74afcda-8c61-4b4b-bee6-b6067d02cbc5 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.118664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74afcda-8c61-4b4b-bee6-b6067d02cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.119153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74afcda-8c61-4b4b-bee6-b6067d02cbc5 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.121484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 49/99] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:08.121632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebe744-596c-4f1b-afeb-655f1578169b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.127654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.128164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.128784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.129041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.129822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.130104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.130404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.148483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:08.149987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:08.151917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:08.161442 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:08.161577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 51/101] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:08.162007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 50/101] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:08.171186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.186036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.189596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ce6df-4650-4a4f-a603-3edfb6a6e791 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.201738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.202426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.202858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.203149 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.204021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:08.204329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.205876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b75e9-1b76-4ac9-978c-186b0c5dc555 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.206082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.219197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.220279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.220763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.221233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.224860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 52/102] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.231311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.248796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ffb87-5433-4b28-b32f-72875eac6d3d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.255178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:08.258584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.259451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.259728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.259998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.267698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:08.267832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.267915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 51/103] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:08.268963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.271231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 53/104] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:08.275326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.276939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.295262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d8100-a4c6-423d-8b75-cdeafd54ca88 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.296572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57a5f3-6462-4c81-b5b7-9f2feb918d5e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.303687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.304539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.304817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.305085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.308410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.310596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.311738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.312200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 54/105] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:08.312428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.312700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.312978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.313753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:08.314060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.315705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.318128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.335853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45745006-3fa6-4abb-a149-92b31e7807ed admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.338014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 52/106] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.344326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.352909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.354119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.354655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.355128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8/users/3ad517a276964868864b69d91a8b9aea/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.363180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1638968175244ce8a396b15be58b4e8, user_id=3ad517a276964868864b69d91a8b9aea, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.366161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.369901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd230da-c77e-49cb-87ee-9e6c398d5e59 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.385152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf282316-3da2-4435-b6db-9dbc1a6ce572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.386976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282316-3da2-4435-b6db-9dbc1a6ce572 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.388250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282316-3da2-4435-b6db-9dbc1a6ce572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.388765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf282316-3da2-4435-b6db-9dbc1a6ce572 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.392046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 55/107] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:08 2021] PUT /identity/v3/projects/f1638968175244ce8a396b15be58b4e8/users/3ad517a276964868864b69d91a8b9aea/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:08.393066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf282316-3da2-4435-b6db-9dbc1a6ce572 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.396030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf282316-3da2-4435-b6db-9dbc1a6ce572 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.398025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 53/108] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.404235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.422542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796ee7-4c05-44b6-a40c-4f4200bc558e None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.423160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796ee7-4c05-44b6-a40c-4f4200bc558e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.423627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796ee7-4c05-44b6-a40c-4f4200bc558e None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.425644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 54/109] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:08.431644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.432246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.432718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.465958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:08.467535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:08.546347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c9405-4b48-408d-8cdb-a4b3ad4558e5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.556904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.558178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.558695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.559178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.560768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.565153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.569170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 56/110] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.575766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.596554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37f9df-8b9e-410d-9d53-5303f8256858 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.601643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 55/111] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:08.609903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.611157 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.611651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.612117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8/users/f027b96ef04e479d8f3b6863f6c94e6c/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.614929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1638968175244ce8a396b15be58b4e8, user_id=f027b96ef04e479d8f3b6863f6c94e6c, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.617810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.641557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.651255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86b263-dea8-4335-b485-7d3210027487 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.653392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 57/112] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:08 2021] PUT /identity/v3/projects/f1638968175244ce8a396b15be58b4e8/users/f027b96ef04e479d8f3b6863f6c94e6c/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:08.734668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.735915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.736406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.736893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.754816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:08.762541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:08.764139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 56/113] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:08.771846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.784444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c05c5-7514-4c78-aa98-66639ebbf47f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.796080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.796823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.797112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.797392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.798293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:08.798661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.800293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.817488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 58/114] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:08.824196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.835455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80891c-c4e2-498e-9e88-014dfdc678b8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.842789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.843686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.843969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.844242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.851242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.853366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.855392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 57/115] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.862382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.875849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6c953-e6e0-4d87-9608-1ede54f63338 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.884531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e033b0a-6357-4984-9ead-5639ebc8e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.885762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e033b0a-6357-4984-9ead-5639ebc8e369 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.886342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e033b0a-6357-4984-9ead-5639ebc8e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.886839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e033b0a-6357-4984-9ead-5639ebc8e369 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.890923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e033b0a-6357-4984-9ead-5639ebc8e369 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.893308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e033b0a-6357-4984-9ead-5639ebc8e369 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.895944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 59/116] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:08 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:08.902490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:08.916089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442fe2b-a1ea-4eb1-8b95-8b501d6b3ff7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:08.926805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:08.927706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:08.927988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:08.928258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8/users/f027b96ef04e479d8f3b6863f6c94e6c/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:08.932525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1638968175244ce8a396b15be58b4e8, user_id=f027b96ef04e479d8f3b6863f6c94e6c, role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:08.933576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:08.933576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:51:08.933576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:51:08.935609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f25393-f1d2-4abb-a469-27cd7050518f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:08.963290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 58/117] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:08 2021] PUT /identity/v3/projects/f1638968175244ce8a396b15be58b4e8/users/f027b96ef04e479d8f3b6863f6c94e6c/roles/fc97b407668046f9b05b539f70740d3d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:09.307401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779d1e-bce7-4453-8e2b-bd3399b634fa None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.308300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779d1e-bce7-4453-8e2b-bd3399b634fa None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.308859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779d1e-bce7-4453-8e2b-bd3399b634fa None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.310850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 60/118] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:09.330818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.331292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.331380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.355706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:09.356890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:09.437255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 59/119] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:09.480693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779d1e-bce7-4453-8e2b-bd3399b634fa None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:09.499293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779d1e-bce7-4453-8e2b-bd3399b634fa None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:09.505882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:09.507180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.507720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.508213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.525901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:09.538161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:09.540085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 61/120] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:09.546057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:09.555630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830bb4-563a-47f0-8afa-454ce110468d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:09.571455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:09.572068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.572348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.572623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.573401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:09.573707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:09.575368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:09.590533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 60/121] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:09.596583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:09.610982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f009b-3500-446b-9b7b-7ee2cf775041 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:09.616769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:09.618025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.618607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.619099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.622917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:09.625447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:09.627373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 62/122] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:09 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:09.634001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:09.646470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a3131-0252-4632-9913-fc4e88ea5f54 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:09.654211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d55fe-8075-4088-9771-520a5115e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:09.655155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d55fe-8075-4088-9771-520a5115e886 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.655419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d55fe-8075-4088-9771-520a5115e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.655687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d55fe-8075-4088-9771-520a5115e886 admin admin] PATH_INFO: `/v3/projects/435c131081f646a0b7b7c5b3710fa26c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.662937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d55fe-8075-4088-9771-520a5115e886 admin admin] RBAC: Authorizing `identity:get_project(project_id=435c131081f646a0b7b7c5b3710fa26c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:09.665012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d55fe-8075-4088-9771-520a5115e886 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:09.666725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 61/123] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:09 2021] GET /identity/v3/projects/435c131081f646a0b7b7c5b3710fa26c => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:09.672784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:09.685936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5d415-6889-4266-aeca-859fca890452 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:09.692233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73256-9961-4413-bb26-f639b7b424d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:09.693431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73256-9961-4413-bb26-f639b7b424d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.693951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73256-9961-4413-bb26-f639b7b424d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.694481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73256-9961-4413-bb26-f639b7b424d1 admin admin] PATH_INFO: `/v3/projects/435c131081f646a0b7b7c5b3710fa26c/users/f027b96ef04e479d8f3b6863f6c94e6c/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.696789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73256-9961-4413-bb26-f639b7b424d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435c131081f646a0b7b7c5b3710fa26c, user_id=f027b96ef04e479d8f3b6863f6c94e6c, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:09.701291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73256-9961-4413-bb26-f639b7b424d1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:09.728986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 63/124] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:09 2021] PUT /identity/v3/projects/435c131081f646a0b7b7c5b3710fa26c/users/f027b96ef04e479d8f3b6863f6c94e6c/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:09.969760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f04c5-5fb4-499f-8bb8-bf34380aeac0 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.970075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f04c5-5fb4-499f-8bb8-bf34380aeac0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.970353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f04c5-5fb4-499f-8bb8-bf34380aeac0 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:09.972138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 62/125] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:09.981147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:09.981736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:09.982259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.005388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:10.006990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:10.084179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e04b-7389-49c8-a146-7ccd3ffc52e5 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.084662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e04b-7389-49c8-a146-7ccd3ffc52e5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.084817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e04b-7389-49c8-a146-7ccd3ffc52e5 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.086510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 63/126] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:10.088084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 64/127] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:10.092316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.092602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.092881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.123167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:10.124371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:10.129907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.136888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 64/128] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:10.145289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc393b9-78b6-408a-b902-68a2494b559a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.153210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.154361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.154919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.155392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.163481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.165545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.167622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 65/129] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:10.174083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.184460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.186644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406b652-951a-43e9-857b-38be2d1c93e4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.196473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.197407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.197705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.197981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.198757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.200445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0291d-f8f1-46cb-918d-b4001c3073f2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.200686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.211042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.212248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.212732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.213203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.236120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:10.243775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:10.245293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 65/130] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:51:10 2021] POST /identity/v3/projects => generated 302 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:10.245695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 66/131] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/roles/reader => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:10.252556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.346525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c436a-68bf-4af6-a2cb-1b8722b7b2c9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.355223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.355918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.356208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.356485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.357266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:10.357572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.359243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.368903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 66/132] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:10.374677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.397001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708522-7ca2-4c45-be73-172fe35e9476 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.407113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.408399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.408923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.409394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] PATH_INFO: `/v3/users/ea62461f07cf4f94a99bdd2054daaae6` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.432319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea62461f07cf4f94a99bdd2054daaae6)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.435804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.439905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 67/133] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/users/ea62461f07cf4f94a99bdd2054daaae6 => generated 289 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:10.446597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.460699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0c931-cc0c-4d99-ae98-8b2288ddc588 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.470514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.471176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.471461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.471732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.483279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.485094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.499353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:10.506014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.522197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc4b8d-23c1-4684-bc36-fb9ac3bb8315 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.530456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6393d9-f68e-4d23-8e8c-187d9cf66771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.531415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6393d9-f68e-4d23-8e8c-187d9cf66771 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.531624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6393d9-f68e-4d23-8e8c-187d9cf66771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.531876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6393d9-f68e-4d23-8e8c-187d9cf66771 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.533071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6393d9-f68e-4d23-8e8c-187d9cf66771 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.535217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6393d9-f68e-4d23-8e8c-187d9cf66771 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.537156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 68/135] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:10.543504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:10.552961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf67e7-8a00-4710-a7dc-a2e0a4f426b8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:10.562271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:10.562931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:10.563216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:10.563491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:10.564351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] RBAC: Adding query filter params (role.id=b76fe42f806e4f0cbee6d48032c8eeba, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=ea62461f07cf4f94a99bdd2054daaae6) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:10.564662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:10.567121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785627fd-8880-401f-a65c-fab9f032ac29 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:10.573586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 68/136] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:10 2021] GET /identity/v3/role_assignments?user.id=ea62461f07cf4f94a99bdd2054daaae6&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=b76fe42f806e4f0cbee6d48032c8eeba => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:11.886830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcbf1-a766-459e-9949-0cd078153433 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:11.887487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcbf1-a766-459e-9949-0cd078153433 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:11.887487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbcbf1-a766-459e-9949-0cd078153433 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:11.889286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 69/137] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:11.895539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:11.896071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:11.896071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:11.923197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:11.924412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:11.932607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 69/138] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:11.970987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbcbf1-a766-459e-9949-0cd078153433 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:11.987290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbcbf1-a766-459e-9949-0cd078153433 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:11.993669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:11.994595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:11.994881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:11.995160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.012509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:12.019865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:12.027082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.031230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 70/139] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:12.039385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f749774-a26c-4e16-8b3b-e9169fb00323 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.046785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.047465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.047745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.048018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.048797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:12.049101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.050805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.059993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 70/140] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:12.065572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.079607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fb8e-f852-414c-81f2-667af253aceb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.087632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.088501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.088777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.089047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] PATH_INFO: `/v3/users/3ad517a276964868864b69d91a8b9aea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.090283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad517a276964868864b69d91a8b9aea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.092082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.093651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 71/141] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/users/3ad517a276964868864b69d91a8b9aea => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:12.099968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.111040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9189-faf5-4336-9d2e-7a7f6397959d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.118779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.119442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.119722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.119999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.128929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.130726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.143804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 71/142] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:12.149833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.159553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a563cd0-abd7-4391-acaf-0f40ba87566d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.170106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57766c-5af5-4241-91f7-aca2afcf59b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.170994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57766c-5af5-4241-91f7-aca2afcf59b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.171274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57766c-5af5-4241-91f7-aca2afcf59b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.171549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57766c-5af5-4241-91f7-aca2afcf59b7 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.172742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57766c-5af5-4241-91f7-aca2afcf59b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.174832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57766c-5af5-4241-91f7-aca2afcf59b7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.177204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 72/143] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:12.184084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.193398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7724-725a-46f4-b41b-44325eec813d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.202241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.202922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.203209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.203488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.204364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=3ad517a276964868864b69d91a8b9aea) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:12.204680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.206674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8619-3341-4f6d-a60b-e4095d23694a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.219825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 72/144] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/role_assignments?user.id=3ad517a276964868864b69d91a8b9aea&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:12.537294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3811dd-a9cd-4d38-bd4c-9752ec47a8ac None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.537662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3811dd-a9cd-4d38-bd4c-9752ec47a8ac None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.537830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3811dd-a9cd-4d38-bd4c-9752ec47a8ac None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.539764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 73/145] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:12.545622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.545913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.546209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.575376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:12.576613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:12.584805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 73/146] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:12.623673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3811dd-a9cd-4d38-bd4c-9752ec47a8ac None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.640303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3811dd-a9cd-4d38-bd4c-9752ec47a8ac None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.647735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.648539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.648817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.649090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.662812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:12.669647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:12.670869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 74/147] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:12.677695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.686707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c1e4f-6bfc-4527-aa09-b0202cc105ac None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.693714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.694396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.694677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.694956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.695720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:12.696022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.697608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.709735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 74/148] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:12.715691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.731030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384703-c62c-4b1b-986d-d6da0b271913 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.735527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.736384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.736662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.736931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.738749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.740879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.746526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 75/149] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:12.752657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.762404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7799652-ffc8-4b87-81bb-e55ad44fbe0e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.769726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.770395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.770674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.770946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.781687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.783484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.799674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 75/150] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:12.815908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.833142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985305c1-3e9f-4809-9fef-9a3dc8804742 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.842284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01df13-00d2-4046-92c9-1f107497dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.843164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01df13-00d2-4046-92c9-1f107497dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.843449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01df13-00d2-4046-92c9-1f107497dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.843722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01df13-00d2-4046-92c9-1f107497dd30 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.845022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01df13-00d2-4046-92c9-1f107497dd30 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.847233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01df13-00d2-4046-92c9-1f107497dd30 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.850401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 76/151] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:12.856010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.868790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a7e9e-66f3-45f0-85ca-6a270a306395 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.872725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67380200-958c-421c-9183-ad6600ffc0c1 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.873004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67380200-958c-421c-9183-ad6600ffc0c1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.873267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67380200-958c-421c-9183-ad6600ffc0c1 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.875203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 77/152] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:12.880789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.881446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.881721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.881994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.882870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=f027b96ef04e479d8f3b6863f6c94e6c) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:12.883174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:12.885032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:12.887105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.887105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.887610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:12.892428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 76/153] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/role_assignments?user.id=f027b96ef04e479d8f3b6863f6c94e6c&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:12.924181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:12.925607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:12.936686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 78/154] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:12.963055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:12.974616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3895ce-55a7-4eb8-add0-89dfddddd9e8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:12.986700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:12.988417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:12.988880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:12.989321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.006473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:13.014164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:13.015533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 77/155] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:13.022558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.032343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c880107-f9d5-4ac8-8ab8-a618bb1eaec6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.047283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.048046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.048322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.048587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.049452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:13.049808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.052076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.061792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 79/156] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.067777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.083928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194afee8-bb32-4417-a4db-55ffc1b3c90c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.088848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.089946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.090436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.090899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.094889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.097838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.100084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 78/157] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.106013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.123489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b7713-a012-4d7e-966a-4d8039f0a6da admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.128228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.128925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.129201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.129527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.140517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.142456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.161106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 80/158] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:13.167240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.180179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269f93-487d-4474-a298-45fdda93d56e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.187767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48556d6-4d05-40de-9df9-346ad569f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.188665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48556d6-4d05-40de-9df9-346ad569f662 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.188949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48556d6-4d05-40de-9df9-346ad569f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.189224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48556d6-4d05-40de-9df9-346ad569f662 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.190546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48556d6-4d05-40de-9df9-346ad569f662 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.193199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48556d6-4d05-40de-9df9-346ad569f662 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.195309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 79/159] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.201388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.210458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1a3cb-b7de-4113-a649-68c182e278ea admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.214918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.215562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.215836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.216100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.216933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] RBAC: Adding query filter params (role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=f027b96ef04e479d8f3b6863f6c94e6c) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:13.217230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.220610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e5967-fc55-4c15-93da-f72f897be692 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.227327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 81/160] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/role_assignments?user.id=f027b96ef04e479d8f3b6863f6c94e6c&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=fc97b407668046f9b05b539f70740d3d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.369961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346586-1b73-413a-b926-40cca87e71c6 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.370315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346586-1b73-413a-b926-40cca87e71c6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.370485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d346586-1b73-413a-b926-40cca87e71c6 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.372334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 80/161] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:13.379023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.379302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.379574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.400045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:13.401253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:13.409357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 82/162] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:13.437640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346586-1b73-413a-b926-40cca87e71c6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.458650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d346586-1b73-413a-b926-40cca87e71c6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.465261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.466381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.466937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.467428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.482084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:13.489847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:13.491339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 81/163] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:13.498340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.507730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb85c-36af-4114-ae34-75012eb711a8 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.515047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.515749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.516051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.516296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.517086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:13.517386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.519171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.529457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 83/164] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.537466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.548290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6fe60-c670-404f-bfc1-f49803b650c3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.553425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.554614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.555135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.555633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] PATH_INFO: `/v3/users/f027b96ef04e479d8f3b6863f6c94e6c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.557035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] RBAC: Authorizing `identity:get_user(user_id=f027b96ef04e479d8f3b6863f6c94e6c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.559514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.562471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 82/165] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/users/f027b96ef04e479d8f3b6863f6c94e6c => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.569218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.579183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564e111-75ea-47eb-b848-c0174494d477 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.584444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.585264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.585712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.586167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.594868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.596859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.606445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 84/166] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:13.612777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.623459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3788e5e-dd6d-4a50-9080-098231e94310 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.627825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539266ac-4f9d-48ec-a81d-2f81d20708b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.629420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539266ac-4f9d-48ec-a81d-2f81d20708b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.629893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539266ac-4f9d-48ec-a81d-2f81d20708b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.630340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539266ac-4f9d-48ec-a81d-2f81d20708b4 admin admin] PATH_INFO: `/v3/projects/435c131081f646a0b7b7c5b3710fa26c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.631701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539266ac-4f9d-48ec-a81d-2f81d20708b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=435c131081f646a0b7b7c5b3710fa26c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.634005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539266ac-4f9d-48ec-a81d-2f81d20708b4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.635876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 83/167] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/projects/435c131081f646a0b7b7c5b3710fa26c => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.642366 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.651818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fdbe8-185e-4f3a-a342-a9f0321a4519 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.656618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.657345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.657722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.658087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.659046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=435c131081f646a0b7b7c5b3710fa26c, user.id=f027b96ef04e479d8f3b6863f6c94e6c) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:13.659448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.661884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54924978-3921-498f-8d31-e633f1b6a5f5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.667797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 85/168] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/role_assignments?user.id=f027b96ef04e479d8f3b6863f6c94e6c&scope.project.id=435c131081f646a0b7b7c5b3710fa26c&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:13.843955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5673f-d608-44d5-8138-0f8dd1503a31 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.844277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5673f-d608-44d5-8138-0f8dd1503a31 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.844517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5673f-d608-44d5-8138-0f8dd1503a31 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.846653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 84/169] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:13.853250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5aae2-15d9-42ed-8682-5cab204df100 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.853532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5aae2-15d9-42ed-8682-5cab204df100 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.853815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5aae2-15d9-42ed-8682-5cab204df100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.872161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-99e5aae2-15d9-42ed-8682-5cab204df100 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:13.873357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-99e5aae2-15d9-42ed-8682-5cab204df100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:13.881375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 86/170] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:13.904339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5673f-d608-44d5-8138-0f8dd1503a31 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.917966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5673f-d608-44d5-8138-0f8dd1503a31 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.922286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.923237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.923508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.923603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e6e9-1d7f-4383-842a-613d27915056 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.924003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e6e9-1d7f-4383-842a-613d27915056 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.924104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.924185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e6e9-1d7f-4383-842a-613d27915056 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.925909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 87/171] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:13.931684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.932020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.932304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.938380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:13.945553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:13.946991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 85/172] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:13.950675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:13.951875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:13.952868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.962191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 88/173] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:13.965850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eb1f-b4cc-4105-8e66-b9871bdc8890 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.970104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.970809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:13.971087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:13.971356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:13.972110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:13.972447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:13.974589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:13.983479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 86/174] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:13.985566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.989313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:13.994772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca1e4-573b-417f-95a2-e29509ff9681 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.998614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2570fb-5e79-4229-b1c0-ed8d80171eb3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:13.999060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:13.999834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:14.000118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:14.000391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:14.001541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:14.003029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:14.003244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:14.003887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:14.004160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:14.004427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] PATH_INFO: `/v3/users/ea62461f07cf4f94a99bdd2054daaae6` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:14.005633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea62461f07cf4f94a99bdd2054daaae6)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:14.005766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 89/175] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:14.007946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:14.009963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 87/176] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:13 2021] GET /identity/v3/users/ea62461f07cf4f94a99bdd2054daaae6 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:14.013147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:14.015476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:14.023118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac699c-8b1a-46e5-97f5-01ab4937d3b8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:14.025016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fc4b8-c731-43c8-860d-f1debb8ab126 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:14.027382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6741d-6de2-43e6-b970-0f29f32179be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:14.028016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6741d-6de2-43e6-b970-0f29f32179be admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:14.028292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6741d-6de2-43e6-b970-0f29f32179be admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:14.028562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6741d-6de2-43e6-b970-0f29f32179be admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:14.029277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6741d-6de2-43e6-b970-0f29f32179be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:14.029408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:14.030226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:14.030505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:14.030773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:14.031214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6741d-6de2-43e6-b970-0f29f32179be admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:14.031931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:14.033933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:14.036445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 88/177] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:14 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:14.042406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:14.051426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 90/178] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:14 2021] POST /identity/v3/users => generated 283 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:14.052084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56d701-bfca-4aac-b55f-584b8f3d2d24 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:14.056798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd9554-1389-4dba-ab13-4506108dac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:14.057692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9554-1389-4dba-ab13-4506108dac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:14.057971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9554-1389-4dba-ab13-4506108dac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:14.058276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd9554-1389-4dba-ab13-4506108dac8f admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8/users/ea62461f07cf4f94a99bdd2054daaae6/roles/b76fe42f806e4f0cbee6d48032c8eeba` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:14.060303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd9554-1389-4dba-ab13-4506108dac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1638968175244ce8a396b15be58b4e8, user_id=ea62461f07cf4f94a99bdd2054daaae6, role_id=b76fe42f806e4f0cbee6d48032c8eeba)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:14.063102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd9554-1389-4dba-ab13-4506108dac8f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:14.077072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 89/179] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:14 2021] PUT /identity/v3/projects/f1638968175244ce8a396b15be58b4e8/users/ea62461f07cf4f94a99bdd2054daaae6/roles/b76fe42f806e4f0cbee6d48032c8eeba => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:51:16.463621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f7a79-a5bc-40b6-9d04-a94b2872d8cb None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.464635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f7a79-a5bc-40b6-9d04-a94b2872d8cb None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.465111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f7a79-a5bc-40b6-9d04-a94b2872d8cb None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.467364 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 91/180] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:16.473985 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.474863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.475335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.494730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:16.496417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:16.552582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e2d25-85ba-49de-bc5d-4283e4548c2d None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.552907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e2d25-85ba-49de-bc5d-4283e4548c2d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.553134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e2d25-85ba-49de-bc5d-4283e4548c2d None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.554932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 92/181] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:16.559528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 90/182] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:16.560972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.561453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.561931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.579767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:16.581238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:16.584016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.591013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 93/183] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:16.596517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a972f1-00d5-4f37-b953-313d28d1c3dd None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.601603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.602444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.602727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.602995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.613723 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:16.617245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.620673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:16.622188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 91/184] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:16.628196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.639392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f374f29-6b0d-4985-a808-4ad19930a908 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.640889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a03368-93f9-4b55-a8bf-4a26ff7188af None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.647139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.647809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.648090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.648364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.649134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:16.649438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.652575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f526c-30f8-442c-a929-b21fd7599ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.653345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6bd4c1-916e-4ac3-aa7f-6e392867febc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.653449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f526c-30f8-442c-a929-b21fd7599ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.653634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f526c-30f8-442c-a929-b21fd7599ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.653969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f526c-30f8-442c-a929-b21fd7599ef8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.667568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 92/185] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.669143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49702-fc95-4b9f-b283-6d058192222f None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.669430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49702-fc95-4b9f-b283-6d058192222f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.669705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f49702-fc95-4b9f-b283-6d058192222f None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.671466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f526c-30f8-442c-a929-b21fd7599ef8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:16.671827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 93/186] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:16.672444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49702-fc95-4b9f-b283-6d058192222f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.679539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-3e9f526c-30f8-442c-a929-b21fd7599ef8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:16.680865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 94/187] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:16.681960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31b1d-9771-46bc-812a-6be9321f5781 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.682247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31b1d-9771-46bc-812a-6be9321f5781 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.686193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31b1d-9771-46bc-812a-6be9321f5781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.689283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f49702-fc95-4b9f-b283-6d058192222f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.694283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.695164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.695447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.695715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] PATH_INFO: `/v3/users/ea62461f07cf4f94a99bdd2054daaae6` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.696963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] RBAC: Authorizing `identity:get_user(user_id=ea62461f07cf4f94a99bdd2054daaae6)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.699154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.700618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-52a31b1d-9771-46bc-812a-6be9321f5781 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:16.700724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 94/188] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/users/ea62461f07cf4f94a99bdd2054daaae6 => generated 289 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.701468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.702854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-52a31b1d-9771-46bc-812a-6be9321f5781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:16.710526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 95/189] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:16.713425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935068-bc17-4e43-a366-c5c6a54a59c8 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.713425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935068-bc17-4e43-a366-c5c6a54a59c8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.713425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935068-bc17-4e43-a366-c5c6a54a59c8 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.713668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9f7bd-1e90-4a99-acb0-bcc000339cbc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.713898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 96/190] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:16.714617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8935068-bc17-4e43-a366-c5c6a54a59c8 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.718052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.718947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.719237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.719511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.720269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:16.720575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.722699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5365d08-4d2f-479d-9356-815e2469f897 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.727977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8935068-bc17-4e43-a366-c5c6a54a59c8 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.732100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 95/191] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.732224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.732746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.733027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.733133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.733292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.733437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.733676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.742232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.743975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.751215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:16.752393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:16.752601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 97/192] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:16.753391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.760030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 96/193] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:16.760030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.762403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f779e-8760-4236-a470-ce21fb052c57 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.766345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.766894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.767170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.767436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.769591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3567a04-a91f-4544-a3d6-8fef40fea87f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.773817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.774664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.774947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.775223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] PATH_INFO: `/v3/users/89a2362037094f4c82a7834d837eac10` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.777811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:16.785643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:16.787184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 98/194] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:16.787922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.794774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a2362037094f4c82a7834d837eac10)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.796918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.798592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 97/195] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/users/89a2362037094f4c82a7834d837eac10 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.799402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.802763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311492c-e46f-477d-9093-9b570924d16a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.808217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.809052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.809234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538153b1-e02b-4cb5-b1b7-a066bd768dd6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.809346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.809573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.811007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.813028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.814291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.814704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 99/196] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.815062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.815344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.815620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.816855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.818564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.819510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.824266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 98/197] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.824266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.828869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd234b-5c3f-4977-a7a0-61fbfad73b34 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.830014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656b600-d244-45f5-852d-e62f07ecaf1b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.833630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.834280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.834557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.834826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.834916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.835466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.835548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:16.835748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.835838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.836022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.837375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.843562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.845199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 100/198] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.845374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.847003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.854119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 99/199] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:16.854889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.856465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec309143-1264-4cc0-8f37-c93c3e2b00d5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.860897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.861504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.861777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.862043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.863433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] RBAC: Adding query filter params (role.id=b76fe42f806e4f0cbee6d48032c8eeba, scope.project.id=f1638968175244ce8a396b15be58b4e8, user.id=ea62461f07cf4f94a99bdd2054daaae6) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:16.863733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.864054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fedcb8-29f2-4f7d-95c4-12df7b6f499a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.865575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.868350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.868971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.869252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.869528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.870260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.871203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 101/200] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/role_assignments?user.id=ea62461f07cf4f94a99bdd2054daaae6&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=b76fe42f806e4f0cbee6d48032c8eeba => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.872158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.875003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.885151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d19b0-ae44-44a1-b3ad-6f3cae593d4e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.890064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.890990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.891274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.891550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] PATH_INFO: `/v3/users/89a2362037094f4c82a7834d837eac10` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.892837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a2362037094f4c82a7834d837eac10)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.895418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 100/201] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:16 2021] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:16.895626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.896693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.897307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 102/202] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/users/89a2362037094f4c82a7834d837eac10 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.915819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.918224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10c123-229e-4ec4-84fa-1bf8243c0e02 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.924265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.927634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4924e-169f-4ef9-afee-fc50efd0c2f7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.928966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.929407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.930037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.932051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.933132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.933992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.934427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.934809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.935285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.938032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 101/203] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:16.946943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.947132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.948863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.958336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796555d-6be0-4bf5-85d4-4281d134ba65 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.959330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 103/204] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:16.965751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:16.967594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.968430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.968816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.969195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.970595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=89a2362037094f4c82a7834d837eac10) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:16.971058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.974270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.975831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e3030-c26b-4567-bd30-202311ab4304 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:16.981801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa128d-a4cd-4891-a681-c25b5d11249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:16.982771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa128d-a4cd-4891-a681-c25b5d11249e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:16.983054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa128d-a4cd-4891-a681-c25b5d11249e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:16.983383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa128d-a4cd-4891-a681-c25b5d11249e admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:16.984823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa128d-a4cd-4891-a681-c25b5d11249e admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:16.986621 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 102/205] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/role_assignments?user.id=89a2362037094f4c82a7834d837eac10&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:16.987200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa128d-a4cd-4891-a681-c25b5d11249e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:16.989824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 104/206] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:16.996763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:17.009272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083af12-7067-43d7-9467-bcac785b9f71 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:17.014442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:17.015200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:17.015486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:17.015821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:17.016736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] RBAC: Adding query filter params (role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=89a2362037094f4c82a7834d837eac10) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:17.017051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:17.019695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467d8bc-f537-4abf-b5b4-f1f90c2b2899 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:17.026639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 103/207] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:16 2021] GET /identity/v3/role_assignments?user.id=89a2362037094f4c82a7834d837eac10&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=fc97b407668046f9b05b539f70740d3d => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.382860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1a82-6738-44b7-8f7f-33a67237f63b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.383386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1a82-6738-44b7-8f7f-33a67237f63b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.383386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e1a82-6738-44b7-8f7f-33a67237f63b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.385187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 105/208] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:19.391165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.391604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.391789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.404391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc680-7ac5-4367-a4b0-098e5c981e49 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.404669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc680-7ac5-4367-a4b0-098e5c981e49 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.404946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc680-7ac5-4367-a4b0-098e5c981e49 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.406854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 106/209] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:19.412524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.412806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.413260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.414371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:19.415783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:19.424638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 104/210] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:19.433762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:19.435256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:19.444108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 107/211] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:19.450653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.460380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765294e-7c81-4abd-858a-f50ec119d427 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.465255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.466778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.470946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.471483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.472477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.476266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b7ead-53eb-42bf-ab70-5f2f815a6339 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.481610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.482795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.483073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.483389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.484958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:19.492187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:19.493943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 105/212] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:19.499800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:19.500525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.508446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:19.515419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 108/213] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:19.516684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.517310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fe6c6-31d3-44a6-8c3b-9d82329fbadd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.526856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.527810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.527914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e095-1ee1-4f10-a8b1-324a85336320 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.528378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.528924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.530048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:19.530613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.532737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.532934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.533585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.533964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.534376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.536091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:19.536883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.538791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.544236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 106/214] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:19.550354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.553898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 109/215] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.560032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.563837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40d5c-3703-419a-a137-ce7a0fb14b15 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.569335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b3857-3c4d-45f2-b9e4-72548c6f680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.570352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3857-3c4d-45f2-b9e4-72548c6f680f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.570738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3857-3c4d-45f2-b9e4-72548c6f680f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.571113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b3857-3c4d-45f2-b9e4-72548c6f680f admin admin] PATH_INFO: `/v3/users/89a2362037094f4c82a7834d837eac10` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.572672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b3857-3c4d-45f2-b9e4-72548c6f680f admin admin] RBAC: Authorizing `identity:get_user(user_id=89a2362037094f4c82a7834d837eac10)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.572797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd672784-6c7e-4f2a-9cb6-154e28067edd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.574855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b3857-3c4d-45f2-b9e4-72548c6f680f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.576464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 107/216] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/users/89a2362037094f4c82a7834d837eac10 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.577748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692dc9-6ba9-47ec-98b3-a855b356426a None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.578034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692dc9-6ba9-47ec-98b3-a855b356426a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.578126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9ab1-7e42-4b19-8b7d-a602fce884e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.578337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692dc9-6ba9-47ec-98b3-a855b356426a None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.579000 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9ab1-7e42-4b19-8b7d-a602fce884e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.579282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9ab1-7e42-4b19-8b7d-a602fce884e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.579552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9ab1-7e42-4b19-8b7d-a602fce884e6 admin admin] PATH_INFO: `/v3/users/89a2362037094f4c82a7834d837eac10` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.580070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 108/217] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:19.581223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7bf0c-cb86-4d88-8011-e457857879c8 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.582107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7bf0c-cb86-4d88-8011-e457857879c8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.582406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7bf0c-cb86-4d88-8011-e457857879c8 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.582876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9ab1-7e42-4b19-8b7d-a602fce884e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a2362037094f4c82a7834d837eac10)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.584090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 109/218] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:19.584729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7bf0c-cb86-4d88-8011-e457857879c8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.584979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9ab1-7e42-4b19-8b7d-a602fce884e6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.588803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 110/219] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/users/89a2362037094f4c82a7834d837eac10 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:19.589624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.589908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.590203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.599714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7bf0c-cb86-4d88-8011-e457857879c8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.603930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a93a5f-9c29-4656-a3cd-4dd4a0edb8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.604744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93a5f-9c29-4656-a3cd-4dd4a0edb8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.605024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93a5f-9c29-4656-a3cd-4dd4a0edb8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.605297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93a5f-9c29-4656-a3cd-4dd4a0edb8e5 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.606498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a93a5f-9c29-4656-a3cd-4dd4a0edb8e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.607119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:19.608290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:19.608501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a93a5f-9c29-4656-a3cd-4dd4a0edb8e5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.610166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 110/220] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.611399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.611685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.611955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.616981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:19.617747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.626621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ec05d-b105-4a47-abbd-b16618062028 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.631502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.632084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:19.632327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.632600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.632917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.633263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:19.634122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.636185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.637820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 112/222] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.641389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 111/223] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:19.641389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.646406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.652963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ebec-9041-4ee2-8dac-a16e92ec611e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.655327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d7c4-1b10-4f31-be19-f9d9362585f9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.657255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.658113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.658420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.658706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/89a2362037094f4c82a7834d837eac10/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.659794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.660930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.661033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7a8c4952924be399955938ffa1ac54, user_id=89a2362037094f4c82a7834d837eac10, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.661204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.661567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.662825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.663589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.664549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.666209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 112/224] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.667006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.676482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eda8-3e1d-43aa-8a26-5458ae0513df admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.680415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 113/225] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:19 2021] PUT /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/89a2362037094f4c82a7834d837eac10/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:19.681416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.735797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.736731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.737003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.737266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/89a2362037094f4c82a7834d837eac10/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.739686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7a8c4952924be399955938ffa1ac54, user_id=89a2362037094f4c82a7834d837eac10, role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.742444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.754914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02510e1-c747-4de0-b260-bee3a52b6483 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.756169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 113/226] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:19 2021] PUT /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/89a2362037094f4c82a7834d837eac10/roles/fc97b407668046f9b05b539f70740d3d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:19.756974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.832607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa900-f829-4954-97d6-c5e3290cc076 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.837382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.838178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.838548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.838895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.839719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.841786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.847626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.848750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.849175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.849865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.866117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 114/227] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:19 2021] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:19.867114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:19.882575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:19.882575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 114/228] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:19.890294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.903261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8505a-e51b-4e45-ac3d-71c84961d8a5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.908650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.909930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.910761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.911249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.912364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:19.912885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.914956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.926729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 115/229] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.933423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.945045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64540e4-2358-436b-88f8-1431a79f390b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:19.951284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:19.952599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:19.953077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:19.953543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] PATH_INFO: `/v3/users/1ef288a65aa347bbb8c3041798084918` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:19.970860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ef288a65aa347bbb8c3041798084918)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:19.975611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:19.977839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 115/230] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/users/1ef288a65aa347bbb8c3041798084918 => generated 297 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:19.984468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:19.995917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9a227-25ec-4583-8fc6-26be03f09494 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:20.001441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:20.002557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:20.003064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:20.003653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:20.013267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:20.015561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:20.026893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:20.033216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:20.044587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fe8f1-0c3a-49c0-ab0f-775e8abf86d7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:20.050549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b566fe-74f0-4c88-b8ac-5a54d5dde0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:20.051440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b566fe-74f0-4c88-b8ac-5a54d5dde0af admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:20.051709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b566fe-74f0-4c88-b8ac-5a54d5dde0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:20.051969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b566fe-74f0-4c88-b8ac-5a54d5dde0af admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:20.053800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b566fe-74f0-4c88-b8ac-5a54d5dde0af admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:20.055869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b566fe-74f0-4c88-b8ac-5a54d5dde0af admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:20.057786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 116/232] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:20 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:20.065241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:20.076136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295e091-dfdb-4a76-8fcd-441c6f7744bb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:20.081696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:20.082889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:20.083389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:20.083823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:20.085122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=1ef288a65aa347bbb8c3041798084918) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:20.085439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:20.088075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1dde0-e75a-4992-b88c-662b0b8b6688 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:20.095573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 117/233] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:20 2021] GET /identity/v3/role_assignments?user.id=1ef288a65aa347bbb8c3041798084918&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:22.562994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba7f8-74fd-424a-87bd-97762c8a9fa3 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.564001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba7f8-74fd-424a-87bd-97762c8a9fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.564473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba7f8-74fd-424a-87bd-97762c8a9fa3 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.567241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 117/234] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:22.576450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.577391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.577857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.593456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d46d-eda8-40dc-ab3c-8dcf36c23c15 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.594101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d46d-eda8-40dc-ab3c-8dcf36c23c15 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.594611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9d46d-eda8-40dc-ab3c-8dcf36c23c15 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.596624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 118/235] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:22.602530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.603062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.603523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.614642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:22.621066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:22.629569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:22.631476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:22.635186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 118/236] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:22.648147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 119/237] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:22.677546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.682592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.690249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698da4a-964c-4f8b-8556-3800699fd5e1 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.692071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f788aa0-926d-4e2d-b9db-ee5a86cc216d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.700989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.703029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.703839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.704842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.705631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.707410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.709430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.709909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.730832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:22.739369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:22.740380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:22.747460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:22.748984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 119/238] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:22.750535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 120/239] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:22.759137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.761127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.777368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec56d-47d7-4e6e-8cec-cf4c447370d1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.779755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595d07d-b799-42a4-9eae-7f93020fef84 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.788476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.789889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.790678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.791544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.792020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.792492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.793475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:22.793954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.794456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.795405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:22.795916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.797794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.798359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.800636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.816982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 120/240] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:22.818197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 121/241] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:22.827174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.828791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.842646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb79f64-63c3-4f82-8ed9-065fcaf0583f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.849040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb5540-3477-40af-98a1-86b2e5f7c34c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.850547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6094-dac6-4b68-a353-dd5877dd0786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.851518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6094-dac6-4b68-a353-dd5877dd0786 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.851795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6094-dac6-4b68-a353-dd5877dd0786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.852066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6094-dac6-4b68-a353-dd5877dd0786 admin admin] PATH_INFO: `/v3/users/89a2362037094f4c82a7834d837eac10` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.853278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6094-dac6-4b68-a353-dd5877dd0786 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a2362037094f4c82a7834d837eac10)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.855289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f61ea-8872-416a-b8ea-dc849596aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.855624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6094-dac6-4b68-a353-dd5877dd0786 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.856619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f61ea-8872-416a-b8ea-dc849596aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.857238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f61ea-8872-416a-b8ea-dc849596aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.857340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 121/242] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/users/89a2362037094f4c82a7834d837eac10 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:22.857793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f61ea-8872-416a-b8ea-dc849596aa03 admin admin] PATH_INFO: `/v3/users/89a2362037094f4c82a7834d837eac10` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.858646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773dcf7-8dc2-41a4-b167-bf0a47941347 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.858924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773dcf7-8dc2-41a4-b167-bf0a47941347 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.859191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773dcf7-8dc2-41a4-b167-bf0a47941347 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.859974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f61ea-8872-416a-b8ea-dc849596aa03 admin admin] RBAC: Authorizing `identity:get_user(user_id=89a2362037094f4c82a7834d837eac10)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.860986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 122/243] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:22.863161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f61ea-8872-416a-b8ea-dc849596aa03 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.865315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 122/244] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/users/89a2362037094f4c82a7834d837eac10 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:22.868205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773dcf7-8dc2-41a4-b167-bf0a47941347 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.869176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.869661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.870172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.886964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773dcf7-8dc2-41a4-b167-bf0a47941347 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.888843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:22.889995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:22.891587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.892475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.892851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.893229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.897643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 123/245] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:22.898677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.902786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.904561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.908078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487e9e-1c4a-4df7-946d-645e48fe24d0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.914579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 123/246] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:22.920667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.928290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.929114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.929396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.929796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.930067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec16bcf-c417-433e-99c8-0783665707b4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.934892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.935727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.936010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.936282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.937482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.938264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.939556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.940141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.941423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 124/247] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:22.942023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.949635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 124/248] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:22.950563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.957245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ef5e1-1f75-4e36-939e-93eeff746467 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.959743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305d0e8-590a-4afa-a1fc-baa0d093773c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.968711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.969340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.969615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.969883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.970744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=89a2362037094f4c82a7834d837eac10) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:22.971003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.971163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.972210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.972704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.972960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.973456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.974889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:22.976761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:22.978896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 125/249] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:22.979920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:22.984053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 125/250] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/role_assignments?user.id=89a2362037094f4c82a7834d837eac10&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:22.990837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74976954-5327-4dda-8ace-aef9c3e15e52 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:22.995917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:22.997197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:22.998034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:22.998539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:22.998826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.000425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.002806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.005160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 126/251] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:22 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:23.011776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.016237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f1e5-f3ed-46c2-b9ec-1318114bba7a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.023279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32fad6-42be-451b-accb-092937ed11f7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.028677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.029707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.030317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.030902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.032112 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] RBAC: Adding query filter params (role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=89a2362037094f4c82a7834d837eac10) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:23.032645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.035753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222141a4-5031-481f-b02b-6b748c6e705d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.042871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 127/252] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/role_assignments?user.id=89a2362037094f4c82a7834d837eac10&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=fc97b407668046f9b05b539f70740d3d => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:23.048803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4f54e-18b3-4aa2-a99c-063b42170420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.048803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f54e-18b3-4aa2-a99c-063b42170420 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.048803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f54e-18b3-4aa2-a99c-063b42170420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.048803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f54e-18b3-4aa2-a99c-063b42170420 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.049199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f54e-18b3-4aa2-a99c-063b42170420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.049199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f54e-18b3-4aa2-a99c-063b42170420 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.054173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999a045-72f2-4755-b56d-0e78ac8f5c66 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.054482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999a045-72f2-4755-b56d-0e78ac8f5c66 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.054699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999a045-72f2-4755-b56d-0e78ac8f5c66 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.056848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 128/253] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:23.064596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.064596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.064596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.086705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 126/254] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:22 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:23.107509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:23.108775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:23.132985 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 129/255] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:23.163966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65551a96-634c-4fbc-b0c2-bc4e7f185c6d None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.164608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65551a96-634c-4fbc-b0c2-bc4e7f185c6d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.165223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65551a96-634c-4fbc-b0c2-bc4e7f185c6d None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.167672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 127/256] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:23.168531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.176729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.179026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.180267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.182560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2158-cb73-44f3-ab59-bd154267c209 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.195058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.195956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.196242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.196535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.209860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:23.211993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:23.222838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 128/257] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:23.231265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:23.238677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:23.239953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 130/258] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:23.246994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.252212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.259428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df77f-2625-4012-a3b0-5da07ea2f07b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.266560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.267694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.268185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.268797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.269892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:23.270683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.272738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.272868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c49e33-eb49-41f7-b6f2-fc6e72bc2bc5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.285111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 129/259] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:23.292067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.295588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.296416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.296699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.296978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.306197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cbba3-fd11-4095-a6d6-22a3440a56a0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.312239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.313605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.314103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.314764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] PATH_INFO: `/v3/users/1ef288a65aa347bbb8c3041798084918` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.316610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] RBAC: Authorizing `identity:get_user(user_id=1ef288a65aa347bbb8c3041798084918)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.319420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.323790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 130/260] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/users/1ef288a65aa347bbb8c3041798084918 => generated 297 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:23.330210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:23.331606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.333892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:23.336601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 131/261] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/roles/reader => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:23.345365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48b138-8ab0-4766-940a-606d025fd9bc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.345581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.354923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.355902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.356225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.356462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.357743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.357859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75883-c733-4c7d-b6df-47b871534bfd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.360049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.361943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 131/262] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:23.366322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.367066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.367346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.367613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.368130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.368385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:23.368686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.370376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.381646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 132/263] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:23.382377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49330a8-286b-47e7-b647-a4da01d4e363 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.387560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.387954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.388505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.388891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.389237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/1ef288a65aa347bbb8c3041798084918/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.391474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7a8c4952924be399955938ffa1ac54, user_id=1ef288a65aa347bbb8c3041798084918, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.394423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.400017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cae20-00b6-443e-9b0d-178a05867d53 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.407825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.407825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.407825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.409923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] PATH_INFO: `/v3/users/4b50c9abc4ea4f1f822e967416ce06ea` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.412966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 132/264] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:23 2021] PUT /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/1ef288a65aa347bbb8c3041798084918/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:51:23.428475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] RBAC: Authorizing `identity:get_user(user_id=4b50c9abc4ea4f1f822e967416ce06ea)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.430784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.432698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 133/265] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/users/4b50c9abc4ea4f1f822e967416ce06ea => generated 297 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:23.439084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.511457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35b1f-ebe8-40e3-b77d-05ea573d55ec admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.516146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.516816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.517138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.517373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.526367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.528201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.539294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 133/266] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:23.546759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.557104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5add22b-a429-411e-8edb-7419448df5bb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.563151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4fc10-a7df-4c69-a9a0-0754af9a6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.564102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4fc10-a7df-4c69-a9a0-0754af9a6dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.564390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4fc10-a7df-4c69-a9a0-0754af9a6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.564662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4fc10-a7df-4c69-a9a0-0754af9a6dfa admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.566045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4fc10-a7df-4c69-a9a0-0754af9a6dfa admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.568131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4fc10-a7df-4c69-a9a0-0754af9a6dfa admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.570120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 134/267] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:23.576660 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:23.586590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede64c-b021-4641-ab72-d697d2634189 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:23.591335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:23.592008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:23.592290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:23.592569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:23.593438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] RBAC: Adding query filter params (role.id=b76fe42f806e4f0cbee6d48032c8eeba, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=4b50c9abc4ea4f1f822e967416ce06ea) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:23.593798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:23.595802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c8a34-fa79-40ed-b721-4a893aea7b5f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:23.602539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 134/268] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:23 2021] GET /identity/v3/role_assignments?user.id=4b50c9abc4ea4f1f822e967416ce06ea&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=b76fe42f806e4f0cbee6d48032c8eeba => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:25.729642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547bce0-7926-47fd-ab9a-eac155acaf15 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.730183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547bce0-7926-47fd-ab9a-eac155acaf15 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.730183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547bce0-7926-47fd-ab9a-eac155acaf15 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.732107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 135/269] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:25.737991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8731-8cdb-44ad-8376-6ae0d23ffaaf None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.738444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8731-8cdb-44ad-8376-6ae0d23ffaaf None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.738638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8731-8cdb-44ad-8376-6ae0d23ffaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.763030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-226c8731-8cdb-44ad-8376-6ae0d23ffaaf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:25.764737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-226c8731-8cdb-44ad-8376-6ae0d23ffaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:25.777196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 135/270] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:25.792754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47979a-d04c-4c07-a458-9ff3fd718971 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.793365 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47979a-d04c-4c07-a458-9ff3fd718971 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.794139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47979a-d04c-4c07-a458-9ff3fd718971 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.797250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 136/271] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:25.808885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47979a-d04c-4c07-a458-9ff3fd718971 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.811111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf77d9-5634-408a-8237-8fe644bb6209 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.811987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf77d9-5634-408a-8237-8fe644bb6209 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.813327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf77d9-5634-408a-8237-8fe644bb6209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.826872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47979a-d04c-4c07-a458-9ff3fd718971 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.832272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:25.833737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.834457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.835008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-7ebf77d9-5634-408a-8237-8fe644bb6209 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:25.835527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.836196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-7ebf77d9-5634-408a-8237-8fe644bb6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:25.844040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 136/272] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:25.847958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556adbb1-8538-4fe4-80f3-8d7b86eeb09a None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.849156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556adbb1-8538-4fe4-80f3-8d7b86eeb09a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.850516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556adbb1-8538-4fe4-80f3-8d7b86eeb09a None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.852707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 137/273] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:25 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:25.853107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:25.858386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.858665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.858937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.864034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:25.866125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 137/274] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:25.871641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.881486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907c7c2-f62e-447a-b92c-ca9c5b6f5792 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.882849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:25.884051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:25.885948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:25.886826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.887106 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.887480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.888818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:25.890722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:25.894292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 138/275] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:25.895580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.895705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 138/276] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:25.898610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.907518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc737c-7e36-4af7-b9e7-34e3f86a1503 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.907824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c69fc5-51ac-4c19-910f-d7dbc46a52f0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.912517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:25.913257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.913529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.913795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.914126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:25.914552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:25.915241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.915736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.916204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.916460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:25.917354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:25.918039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:25.919849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:25.934189 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 139/277] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:25.934189 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.941415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6567d7-906e-4a53-8697-2798144347e7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.942836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 139/278] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:25 2021] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:25.943922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.953467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:25.954471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.954826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.955179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.961348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7953c-0b27-4b11-a435-80a0bfc2e973 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.966403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a12dd-2702-402e-9311-733170318ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:25.967588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a12dd-2702-402e-9311-733170318ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:25.967975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a12dd-2702-402e-9311-733170318ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:25.968349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a12dd-2702-402e-9311-733170318ff0 admin admin] PATH_INFO: `/v3/users/a67a43b731fc4a4bbe7d8e0476dbbc79` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:25.968763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:25.977312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:25.978954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 140/279] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:25.985847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:25.992259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a12dd-2702-402e-9311-733170318ff0 admin admin] RBAC: Authorizing `identity:get_user(user_id=a67a43b731fc4a4bbe7d8e0476dbbc79)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:25.994875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a12dd-2702-402e-9311-733170318ff0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:25.996354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ea49-f9ea-43fd-9ac0-493a0b01cc84 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:25.997091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 140/280] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:25 2021] GET /identity/v3/users/a67a43b731fc4a4bbe7d8e0476dbbc79 => generated 293 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.001705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.002691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07554-dd64-49cb-978d-feff0b576e87 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.002966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.003069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07554-dd64-49cb-978d-feff0b576e87 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.003786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.003897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07554-dd64-49cb-978d-feff0b576e87 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.004066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.005177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:26.005488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.005579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 141/281] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:26.006984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07554-dd64-49cb-978d-feff0b576e87 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.007619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84584b5-5e3e-41d9-bd2b-bb31504f71c2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.018240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 141/282] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.019729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.020020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.020302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.022930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07554-dd64-49cb-978d-feff0b576e87 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.027702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.028370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.028911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.029192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.031101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, user.id=a67a43b731fc4a4bbe7d8e0476dbbc79, scope.system=all) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:26.031485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.033412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.041095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:26.042338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 142/283] 10.222.0.57 () {56 vars in 1329 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/role_assignments?user.id=a67a43b731fc4a4bbe7d8e0476dbbc79&scope.system=all&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.042469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:26.045191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.057436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 142/284] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:26.063407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964540e-e5c0-4673-aca7-27d75eb9e215 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.069046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.070012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.070342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.070618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] PATH_INFO: `/v3/users/1ef288a65aa347bbb8c3041798084918` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.072034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ef288a65aa347bbb8c3041798084918)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.074324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.076205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 143/285] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/users/1ef288a65aa347bbb8c3041798084918 => generated 297 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.082271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.084466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.100358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d44652-02e0-457d-996b-25195b3865e9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.103812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbc4c-3271-4476-af51-b2ed1d80fcd4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.106694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.107841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.108347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.108763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.108936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.109630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.110015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.110427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.120201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.122325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.124980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:26.134472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:26.135416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 144/286] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:26.136127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 143/287] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:26.143953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.147263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.153699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710542a8-642f-4f77-aefb-8e51c2ebe4d0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.158949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcf789-f5c3-462e-9470-11bb16389c5a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.159849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.161636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.161931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.162291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.163886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.166371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.166551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.167442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.167929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.168424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.169417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:26.169945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.171843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.173969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 145/288] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.175815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.188026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520eb3-52ff-4684-a8a4-34a981616249 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.193918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 144/289] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.195792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.206871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.207557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.207839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.208112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.208979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=1ef288a65aa347bbb8c3041798084918) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:26.209289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.212275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.216576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d370cd-e4cb-4c7f-a962-4b26dbc26202 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.220968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 146/290] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/role_assignments?user.id=1ef288a65aa347bbb8c3041798084918&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:26.222719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.223621 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.223938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.224212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] PATH_INFO: `/v3/users/4b50c9abc4ea4f1f822e967416ce06ea` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.225939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b50c9abc4ea4f1f822e967416ce06ea)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.228503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.230862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 145/291] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/users/4b50c9abc4ea4f1f822e967416ce06ea => generated 297 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:26.237231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.249668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d298bb-f451-4606-a6a0-a78a9f39f60f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.254516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a7eb5-edd7-4ccb-8913-61bef9a3ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.255409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a7eb5-edd7-4ccb-8913-61bef9a3ac31 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.255687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a7eb5-edd7-4ccb-8913-61bef9a3ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.255957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a7eb5-edd7-4ccb-8913-61bef9a3ac31 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.257317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a7eb5-edd7-4ccb-8913-61bef9a3ac31 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.259520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a7eb5-edd7-4ccb-8913-61bef9a3ac31 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.261613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 147/292] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:26 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:26.268384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:26.278819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260a0a5-dc06-44b1-a2fc-9fa43b8e01a2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:26.283878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f528-d37c-4ee7-a1c4-a938a9174738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:26.285325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f528-d37c-4ee7-a1c4-a938a9174738 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:26.285852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f528-d37c-4ee7-a1c4-a938a9174738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:26.286121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f528-d37c-4ee7-a1c4-a938a9174738 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/4b50c9abc4ea4f1f822e967416ce06ea/roles/b76fe42f806e4f0cbee6d48032c8eeba` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:26.288698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f528-d37c-4ee7-a1c4-a938a9174738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7a8c4952924be399955938ffa1ac54, user_id=4b50c9abc4ea4f1f822e967416ce06ea, role_id=b76fe42f806e4f0cbee6d48032c8eeba)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:26.291648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f528-d37c-4ee7-a1c4-a938a9174738 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:26.307225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 146/293] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:26 2021] PUT /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54/users/4b50c9abc4ea4f1f822e967416ce06ea/roles/b76fe42f806e4f0cbee6d48032c8eeba => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:28.536402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4adc78-277a-48d3-9baf-3d395cfc18b5 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.536949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4adc78-277a-48d3-9baf-3d395cfc18b5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.536949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4adc78-277a-48d3-9baf-3d395cfc18b5 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.538953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 148/294] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:28.544841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.545240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.545418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.562940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:28.564115 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:28.604022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ecc0d-129b-42d9-9fa2-e7dbcb836f59 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.604022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ecc0d-129b-42d9-9fa2-e7dbcb836f59 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.604022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ecc0d-129b-42d9-9fa2-e7dbcb836f59 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.604022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 149/295] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:28.611725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.612010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.612355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.627765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 147/296] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:28.635110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:28.636304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:28.644252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 150/297] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:28.656097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.666081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971baa5-deee-42a4-a953-40a8e8656e53 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.668182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.673773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.674995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.675471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.675957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.677536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3fbd1-c682-443e-bf65-5a6924f28119 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.682697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.683485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.683763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.684032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.688566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:28.696146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:28.697739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 148/298] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:28.702200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:28.704266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.709472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:28.711294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 151/299] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:28.717282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.717393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eccf0f-77e2-4b91-bfeb-d98726617c3f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.722459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.723108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.723584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.723861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.725163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:28.725469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.727404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.727976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8006402-fee5-41f3-be86-c2c50d6158ad admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.732392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.733065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.733344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.733616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.734391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:28.734691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.736263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.736486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 149/300] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:28.743275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.749873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 152/301] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:28.753535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64f50-16d5-44af-a342-d8ede3a5b9f8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.756097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.758245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.759104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.759379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.759650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] PATH_INFO: `/v3/users/9d5d7516bf3d44a2a8ccf54961729f9f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.765749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c51b35-d68f-4202-943a-21001f5f3268 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.770462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.771291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.771560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.771822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] PATH_INFO: `/v3/users/a67a43b731fc4a4bbe7d8e0476dbbc79` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.773238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] RBAC: Authorizing `identity:get_user(user_id=a67a43b731fc4a4bbe7d8e0476dbbc79)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.774794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5d7516bf3d44a2a8ccf54961729f9f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.775510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.776935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.778636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 150/303] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/users/9d5d7516bf3d44a2a8ccf54961729f9f => generated 293 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:28.782350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 153/303] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/users/a67a43b731fc4a4bbe7d8e0476dbbc79 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:28.784780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.788993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.796217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c886f-5731-437c-aa05-8a6baedd27c3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.799875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b732f5-1606-4596-8483-6907efe24178 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.800775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.801818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.802093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.802489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] PATH_INFO: `/v3/system/users/a67a43b731fc4a4bbe7d8e0476dbbc79/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.803998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a67a43b731fc4a4bbe7d8e0476dbbc79, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.805075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:28.805075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:51:28.805075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:51:28.805952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.810648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.811304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.811666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.811869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.812736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] RBAC: Adding query filter params (role.id=b76fe42f806e4f0cbee6d48032c8eeba, user.id=9d5d7516bf3d44a2a8ccf54961729f9f, scope.system=all) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:28.813071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.815220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d0e8-7755-47b5-a631-78371ed41682 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.819001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 151/304] 10.222.0.57 () {58 vars in 1355 bytes} [Wed Dec 15 12:51:28 2021] PUT /identity/v3/system/users/a67a43b731fc4a4bbe7d8e0476dbbc79/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:51:28.825238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 154/305] 10.222.0.57 () {56 vars in 1329 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/role_assignments?user.id=9d5d7516bf3d44a2a8ccf54961729f9f&scope.system=all&role.id=b76fe42f806e4f0cbee6d48032c8eeba => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:28.825238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc48a-ad18-404c-b8e3-8e62779cb9a5 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.825238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc48a-ad18-404c-b8e3-8e62779cb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.825238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc48a-ad18-404c-b8e3-8e62779cb9a5 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.825238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 155/306] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:28.831920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492973-3ca7-4089-8f66-6f998496ab71 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.832197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492973-3ca7-4089-8f66-6f998496ab71 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.832470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2492973-3ca7-4089-8f66-6f998496ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.852345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d2492973-3ca7-4089-8f66-6f998496ab71 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:28.853612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d2492973-3ca7-4089-8f66-6f998496ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:28.862126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 156/307] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:28.887344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.898914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780e81-2352-411f-9f29-ec1957ddc285 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.903664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.904514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.904803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.905073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.918489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:28.925692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db538-ee69-4e88-947e-56ed59ec81f1 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.926019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db538-ee69-4e88-947e-56ed59ec81f1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.930571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0db538-ee69-4e88-947e-56ed59ec81f1 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.930571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 157/308] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:28.931020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:28.931503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 152/309] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:28.934820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.935114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.935358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.939559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.950409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54001f01-a0e9-472c-b802-50857ad536cc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:28.954116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:28.955368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:28.956851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:28.957552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:28.957835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:28.958114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:28.959023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:28.959366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:28.961013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:28.974204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 158/310] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:28.977986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 153/311] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:28.984699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.992082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:28.997996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b99ae9-c60d-49fe-aaf2-fdee9a859d2e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:29.003234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a54f2-aa19-4d48-b7f9-4b0c487ccef6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:29.003722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:29.005107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:29.005613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:29.006139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] PATH_INFO: `/v3/users/4b50c9abc4ea4f1f822e967416ce06ea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:29.008103 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:29.008282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b50c9abc4ea4f1f822e967416ce06ea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:29.008928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:29.009219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:29.009494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:29.010962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:29.011955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:29.012825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:29.014201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 159/312] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/users/4b50c9abc4ea4f1f822e967416ce06ea => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:29.015160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 154/313] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:29.021866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:29.023247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:29.033925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f4b98-7f39-486e-bb98-a74bacf42581 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:29.037702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cca592-f69a-4967-9d8d-703c02e546e9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:29.040728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:29.041949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:29.042528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:29.042632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:29.043113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] PATH_INFO: `/v3/groups` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:29.043232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:29.043506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:29.043787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:29.044902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:29.046266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:29.046266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:29.046266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:29.047938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:29.053003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:29.055358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:29.070221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 155/315] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:29.070439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 160/315] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Dec 15 12:51:29 2021] POST /identity/v3/groups => generated 229 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:29.072861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:29.085544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defc4d2-4ec9-4254-839b-44c0d9d9b156 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:29.090323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960ae33-867d-4801-be98-6b1fceb0ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:29.091160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ae33-867d-4801-be98-6b1fceb0ab3b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:29.091440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ae33-867d-4801-be98-6b1fceb0ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:29.091716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ae33-867d-4801-be98-6b1fceb0ab3b admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:29.093058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960ae33-867d-4801-be98-6b1fceb0ab3b admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:29.095182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960ae33-867d-4801-be98-6b1fceb0ab3b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:29.098879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 156/316] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:29 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:29.105321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:29.115973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca9330-245e-42df-9234-fd5d841f98d1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:29.127291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:29.127641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:29.130219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:29.130219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:29.130219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] RBAC: Adding query filter params (role.id=b76fe42f806e4f0cbee6d48032c8eeba, scope.project.id=ca7a8c4952924be399955938ffa1ac54, user.id=4b50c9abc4ea4f1f822e967416ce06ea) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:29.130219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:29.131466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9da5c6-6136-49ae-8fe3-df0f137753ed admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:29.138922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 161/317] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:29 2021] GET /identity/v3/role_assignments?user.id=4b50c9abc4ea4f1f822e967416ce06ea&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=b76fe42f806e4f0cbee6d48032c8eeba => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:31.198579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097665b-c614-4c58-9fd3-ed91e4c6da80 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.199092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097665b-c614-4c58-9fd3-ed91e4c6da80 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.199165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097665b-c614-4c58-9fd3-ed91e4c6da80 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.200973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 157/318] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:31.207280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cec65e-f3b7-444c-b928-7423d059fc1f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.207682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cec65e-f3b7-444c-b928-7423d059fc1f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.207842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cec65e-f3b7-444c-b928-7423d059fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.225138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-79cec65e-f3b7-444c-b928-7423d059fc1f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:31.226339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-79cec65e-f3b7-444c-b928-7423d059fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:31.233800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 162/319] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:31.248435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9095c-5976-443e-8cde-4132776e317b None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.248724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9095c-5976-443e-8cde-4132776e317b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.249003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9095c-5976-443e-8cde-4132776e317b None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.250846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 158/320] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:31.256445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.256733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.256910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9095c-5976-443e-8cde-4132776e317b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.257009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.269423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9095c-5976-443e-8cde-4132776e317b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.273425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.274187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.274465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.274627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:31.274736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.275780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:31.283468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 163/321] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:31.285337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:31.292416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:31.293675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 159/322] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:31.299635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.307522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.309021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcb7f-d17b-4c9f-854a-6df52f63d476 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.313290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.313951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.314310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.314586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.315381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:31.315686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.317275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.317521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0365c04-4a89-42be-b52b-a22a06407d86 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.321857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.322795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.322899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.323164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.325714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 164/323] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:31.332082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.334374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:31.341094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734c152-10e6-416a-b54d-6a3892d21887 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.341224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:31.342476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 160/324] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:31.348817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.350029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.350902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.351173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.351436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] PATH_INFO: `/v3/users/9d5d7516bf3d44a2a8ccf54961729f9f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.352625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5d7516bf3d44a2a8ccf54961729f9f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.354752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.356310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 165/325] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/users/9d5d7516bf3d44a2a8ccf54961729f9f => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:31.360279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c9ed2-3244-4381-b3f5-ba6db2e1a033 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.361854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.364754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.365375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.365650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.365917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.366695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:31.366990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.368556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.371148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f472-3d9e-416b-8726-c2c935226bf1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.375378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.376199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.376477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.376748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] PATH_INFO: `/v3/system/users/9d5d7516bf3d44a2a8ccf54961729f9f/roles/b76fe42f806e4f0cbee6d48032c8eeba` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.377576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 161/326] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:31.378294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d5d7516bf3d44a2a8ccf54961729f9f, role_id=b76fe42f806e4f0cbee6d48032c8eeba)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.379305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:31.379305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:31.379305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:31.380165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.383369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.389311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 166/327] 10.222.0.57 () {58 vars in 1355 bytes} [Wed Dec 15 12:51:31 2021] PUT /identity/v3/system/users/9d5d7516bf3d44a2a8ccf54961729f9f/roles/b76fe42f806e4f0cbee6d48032c8eeba => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:51:31.393023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244f052-c088-4030-92b6-478233ef7f6c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.398020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870d3ae-6fa0-4bd9-b95b-850bc6b3906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.399054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870d3ae-6fa0-4bd9-b95b-850bc6b3906d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.399338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870d3ae-6fa0-4bd9-b95b-850bc6b3906d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.399604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870d3ae-6fa0-4bd9-b95b-850bc6b3906d admin admin] PATH_INFO: `/v3/users/a67a43b731fc4a4bbe7d8e0476dbbc79` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.400906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870d3ae-6fa0-4bd9-b95b-850bc6b3906d admin admin] RBAC: Authorizing `identity:get_user(user_id=a67a43b731fc4a4bbe7d8e0476dbbc79)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.403114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870d3ae-6fa0-4bd9-b95b-850bc6b3906d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.405034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 162/328] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/users/a67a43b731fc4a4bbe7d8e0476dbbc79 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:31.412435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.423009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a941-4907-48dd-a4d3-218a48daa4f5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.427539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.428218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.428499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.428772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.429630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] RBAC: Adding query filter params (role.id=864e7e8eaded488ba7be82618e54cf49, user.id=a67a43b731fc4a4bbe7d8e0476dbbc79, scope.system=all) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:31.429940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.431901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8268a8-9f29-4756-9795-e52f38973b1b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.452800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 167/329] 10.222.0.57 () {56 vars in 1329 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/role_assignments?user.id=a67a43b731fc4a4bbe7d8e0476dbbc79&scope.system=all&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:31.453002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10a0a-7611-44dd-9552-4deb0c369828 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.453002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10a0a-7611-44dd-9552-4deb0c369828 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.453002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe10a0a-7611-44dd-9552-4deb0c369828 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.453002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 163/330] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:31.458570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.458888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.459127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.478914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:31.480189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:31.488821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 168/331] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:31.513163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10a0a-7611-44dd-9552-4deb0c369828 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.526793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe10a0a-7611-44dd-9552-4deb0c369828 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.531272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ee356-971e-4586-96ff-1dff449f5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.532104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ee356-971e-4586-96ff-1dff449f5a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.532384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ee356-971e-4586-96ff-1dff449f5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.532656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ee356-971e-4586-96ff-1dff449f5a25 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.533986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ee356-971e-4586-96ff-1dff449f5a25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.536025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ee356-971e-4586-96ff-1dff449f5a25 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.537928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 164/332] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:31.544060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:31.553587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809f576-7b9c-4338-ac6e-552b17393802 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:31.558384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3bf04-d2c1-410f-b47b-8a4bcdbe4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:31.559079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3bf04-d2c1-410f-b47b-8a4bcdbe4c37 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:31.559356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3bf04-d2c1-410f-b47b-8a4bcdbe4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:31.559629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3bf04-d2c1-410f-b47b-8a4bcdbe4c37 admin admin] PATH_INFO: `/v3/groups` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:31.560368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3bf04-d2c1-410f-b47b-8a4bcdbe4c37 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:31.562398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3bf04-d2c1-410f-b47b-8a4bcdbe4c37 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:31.580454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 169/333] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Dec 15 12:51:31 2021] POST /identity/v3/groups => generated 226 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:33.966609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdddb79-931b-44e3-b674-e8df23600e67 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:33.967110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdddb79-931b-44e3-b674-e8df23600e67 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:33.967110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdddb79-931b-44e3-b674-e8df23600e67 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:33.968876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 165/334] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:33.976095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:33.976544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:33.976720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.005484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:34.006743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:34.019264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 170/335] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:34.065104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdddb79-931b-44e3-b674-e8df23600e67 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.077595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdddb79-931b-44e3-b674-e8df23600e67 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.082577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.083361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.083642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.083911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.102734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:34.109820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 15 12:51:34.111371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 166/336] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:34.117796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.127119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15b64-12f2-498a-bdc5-591f308da446 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.134176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.134874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.135154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.135432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.136204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:34.136510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:34.138121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:34.150906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 171/337] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:34.157356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.171864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8702e0-c193-4ace-93bc-c56157f24b57 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.176651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740b62c-8101-49a0-945e-ed6d121ddf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.177513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b62c-8101-49a0-945e-ed6d121ddf97 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.177795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b62c-8101-49a0-945e-ed6d121ddf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.178067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740b62c-8101-49a0-945e-ed6d121ddf97 admin admin] PATH_INFO: `/v3/users/9d5d7516bf3d44a2a8ccf54961729f9f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.182921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b62c-8101-49a0-945e-ed6d121ddf97 admin admin] RBAC: Authorizing `identity:get_user(user_id=9d5d7516bf3d44a2a8ccf54961729f9f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:34.185072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740b62c-8101-49a0-945e-ed6d121ddf97 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:34.187038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 167/338] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/users/9d5d7516bf3d44a2a8ccf54961729f9f => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:34.193528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.212492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8439692-ff85-4eed-8158-0a511a4bb7b4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.222498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.223171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.223452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.223729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.224579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] RBAC: Adding query filter params (role.id=b76fe42f806e4f0cbee6d48032c8eeba, user.id=9d5d7516bf3d44a2a8ccf54961729f9f, scope.system=all) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:34.224888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:34.226777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c97d-f280-486c-b61b-0d9eb60ed2d7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:34.247804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 172/339] 10.222.0.57 () {56 vars in 1329 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/role_assignments?user.id=9d5d7516bf3d44a2a8ccf54961729f9f&scope.system=all&role.id=b76fe42f806e4f0cbee6d48032c8eeba => generated 510 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:34.782945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d2711-0ff4-499c-bce6-e1419f1cf3dc None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.783354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d2711-0ff4-499c-bce6-e1419f1cf3dc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.783551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d2711-0ff4-499c-bce6-e1419f1cf3dc None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.786033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 168/340] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:34.792432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.792729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.793007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.827439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:34.828678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:34.840938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 173/341] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:34.878782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d2711-0ff4-499c-bce6-e1419f1cf3dc None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.896717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d2711-0ff4-499c-bce6-e1419f1cf3dc None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.904218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.905149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.905430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.905701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.920152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:34.928065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:34.929554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 169/342] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:34.937564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.949483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff852ae-7d17-4dd9-93f4-9a719460ccc8 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.954055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.954746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.955025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.955298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:34.956610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:34.956911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:34.958550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:34.970007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 174/343] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:34.976263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:34.988075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86923-cc7e-4182-9146-b9b246b2cdea admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:34.995065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:34.996261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:34.996261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:34.996261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.008069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.009840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.021905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 170/344] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:35.031084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.043392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9530a10-19bd-41e0-9581-7bc7e1971ea4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.048718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.050126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.050477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.050768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.052030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.054074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.055796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 175/345] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:35.064142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.076154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa204c-d530-4549-bee7-2dad16d010a8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.081499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.082426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.082728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.083000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.089683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.090749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:35.090749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:51:35.090749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:51:35.091960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7482c-9373-469c-a3b8-6f734ac29e47 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.093911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 171/346] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:35.100702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.110517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104d37a-9d9a-4260-b90c-a691cb9ea57e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.115025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.115671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.115954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.116229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.117079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=f1638968175244ce8a396b15be58b4e8) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:35.117381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.119279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e62763-28cc-43a5-b26d-f5e7292a5edc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.128898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 176/347] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=fc97b407668046f9b05b539f70740d3d => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:35.308495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395a2b-ee92-40b3-8e38-784e5d13482d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.308830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395a2b-ee92-40b3-8e38-784e5d13482d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.309019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6395a2b-ee92-40b3-8e38-784e5d13482d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.311144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 172/348] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:35.317855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.318183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.318442 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.335051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade21318-47f2-480e-8232-3c8a96b09165 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.335372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade21318-47f2-480e-8232-3c8a96b09165 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.335616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade21318-47f2-480e-8232-3c8a96b09165 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.337748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 173/349] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:35.341347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:35.342597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:35.345696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.345696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.345926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.365222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 177/350] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:35.368543 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:35.369968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:35.384289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 174/351] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:35.391320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.404235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9b859-1ce8-40ad-a8ee-5340088d46d4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.414450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.415274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.415553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.415824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.422104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.433948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5d896-cb97-416f-9e85-1dc3d59cb425 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.443345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:35.447482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.448293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.448581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.448834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.450434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:35.451709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 178/352] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:35.458194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.467537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:35.475082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:35.475525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3018-c641-4af8-9ec7-5de3cc4c5b23 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.477546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 175/353] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:35.483386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.491052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.491762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.492001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.492266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.493024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:35.493322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.494950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.505158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30e623-8d49-44ee-ae3b-60ee489de295 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.509808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 179/354] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:35.515567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.516622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.517294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.517569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.517839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.518738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:35.519048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.520687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.531130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd6c6-85df-49e8-aee7-7ef08597c3b1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.534839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 176/355] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:35.539199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.540425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.540766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.541160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.541632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.551071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.553174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.561655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223230db-95ec-4c1b-b865-4a92e1f42567 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.567010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 180/356] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:35.571115 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.572072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.573203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.574555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.574846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.587509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a96cac-7489-4d93-b4fa-764d9ce7da93 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.588000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.590440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.595785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.597045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.597581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.598089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.600657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.601151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 177/357] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:35.603511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.605524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 181/358] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:35.607476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.611107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.617203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d84e-93d6-4efc-b698-aa0ec9d13a88 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.623962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262dac0-8a65-44c0-9ee7-dd1665876bc5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.627234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.628390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.628878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.629326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.631201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.633425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.635347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 178/359] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:35.638946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.639776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.640053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.640324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.641566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.642544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.642653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:35.642653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:35.642653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:35.644363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.646290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 182/360] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:35.652816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.654465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bec6a-f9dc-45cd-842f-53c3ae36fbc4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.659311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.660616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.661076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.661541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.663987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.666313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.671099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce73095-3139-4bc1-965e-6d599c59a794 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.671360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 179/361] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:35.675510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:35.685408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54b3c-fab4-49ba-8705-7187b49fee37 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:35.690358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.690815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:35.691429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.691536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:35.691744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.692013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.692333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:35.692792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:35.692891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=ca7a8c4952924be399955938ffa1ac54) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:35.693150 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.694074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=f1638968175244ce8a396b15be58b4e8) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:35.694594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:35.695029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9e906-e5d8-4014-afa5-3db971aaea1c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.696991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e6e32-2aba-4514-804e-0a5d4309f905 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:35.703078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 183/362] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:35.706433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 180/363] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:35 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:36.035213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52eabf-4617-4516-9c92-4c367c5ad369 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.035975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52eabf-4617-4516-9c92-4c367c5ad369 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.036048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52eabf-4617-4516-9c92-4c367c5ad369 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.037764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 184/364] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:36.043716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.044147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.044320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.071277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:36.072393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:36.080368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 181/365] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:36.116870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52eabf-4617-4516-9c92-4c367c5ad369 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.136100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52eabf-4617-4516-9c92-4c367c5ad369 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.146502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.147318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.147594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.147861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.167894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:36.175277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:36.176511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 185/366] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:36.182703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.195671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e5a05-249c-4333-86d6-7e4717ba8999 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.204582 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.205249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.205527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.205880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.206677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:36.206982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.208576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.219694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 182/367] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:36.226376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.238428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c26b2-de15-4098-94e4-5687b2b4f1fc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.244731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.245363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.245642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.245915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.255470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.257232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.269256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 186/368] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:36.275411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.287041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0600-6f42-4a80-a576-2b5471df476d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.294802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.295669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.295954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.296231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.297488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.299628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.301595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 183/369] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:36.307517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.316561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c62c7-98cf-474f-9110-041df682dbfd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.326454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846cb08-a4e4-4be7-8bc0-42b729ad3d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.327243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846cb08-a4e4-4be7-8bc0-42b729ad3d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.327518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846cb08-a4e4-4be7-8bc0-42b729ad3d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.327788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846cb08-a4e4-4be7-8bc0-42b729ad3d58 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.329001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846cb08-a4e4-4be7-8bc0-42b729ad3d58 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.331473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846cb08-a4e4-4be7-8bc0-42b729ad3d58 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.333059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 187/370] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:36.339266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.355218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06fd7-369c-409c-9ad3-7dd016f80335 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.359856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.360497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.360775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.361053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.362440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=ca7a8c4952924be399955938ffa1ac54) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:36.362760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.364595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56407a-c503-4d9d-bdd3-2905a1ea6721 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.374274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 184/371] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=fc97b407668046f9b05b539f70740d3d => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:36.410093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f6d10-82d3-469b-9a93-44bb49814318 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.410662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f6d10-82d3-469b-9a93-44bb49814318 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.410908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f6d10-82d3-469b-9a93-44bb49814318 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.412670 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 188/372] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:36.418500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.418783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.419057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.443388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:36.444729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:36.452561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 185/373] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:36.492979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f6d10-82d3-469b-9a93-44bb49814318 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.508233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f6d10-82d3-469b-9a93-44bb49814318 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.512694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.513483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.513757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.514025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.529540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:36.536842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:36.538371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 189/374] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:36.544647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.560903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39245f45-00eb-4fd4-8b81-bdd27bb6997c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.565633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.566326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.566604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.566878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.567643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:36.567954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.569560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.582927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 186/375] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:36.588806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.598813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8af0a-343b-4df1-8f40-d8b0783aca09 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.606251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.606905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.607170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.607434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.622783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.624575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.636400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 190/376] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:36.642251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.657004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919d43b-4c43-44ef-9cda-e4fa28413c4a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.666360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.667224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.667550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.667738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] PATH_INFO: `/v3/projects/ce52653451e74d3f9f778f9e368425dc` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.670899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce52653451e74d3f9f778f9e368425dc)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.672709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.674842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 187/377] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/projects/ce52653451e74d3f9f778f9e368425dc => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:36.681006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.692738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296091-de2e-4bb1-a5f6-093061712394 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.701493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0474e-f502-4031-b52a-713ecb189fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.702392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0474e-f502-4031-b52a-713ecb189fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.702671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0474e-f502-4031-b52a-713ecb189fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.702940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0474e-f502-4031-b52a-713ecb189fbd admin admin] PATH_INFO: `/v3/groups/18c4ea35ad2143cea8f574f7a0fff43a` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.719141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0474e-f502-4031-b52a-713ecb189fbd admin admin] RBAC: Authorizing `identity:get_group(group_id=18c4ea35ad2143cea8f574f7a0fff43a)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.721115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0474e-f502-4031-b52a-713ecb189fbd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.723468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 191/378] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/groups/18c4ea35ad2143cea8f574f7a0fff43a => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:36.729919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:36.743499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bed2-faf8-490e-a1b5-94218967be20 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:36.750194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:36.750823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:36.751106 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:36.751373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:36.752220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] RBAC: Adding query filter params (group.id=18c4ea35ad2143cea8f574f7a0fff43a, role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=ce52653451e74d3f9f778f9e368425dc) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:36.753049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:36.754928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f121fb4-0b79-43d6-bfae-8547fcaec7d6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:36.762881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 188/379] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:36 2021] GET /identity/v3/role_assignments?group.id=18c4ea35ad2143cea8f574f7a0fff43a&scope.project.id=ce52653451e74d3f9f778f9e368425dc&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:38.345651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c940a-1d1d-4704-acd0-719dcd60fe3d None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.346952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c940a-1d1d-4704-acd0-719dcd60fe3d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.346952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c940a-1d1d-4704-acd0-719dcd60fe3d None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.348795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 192/380] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:38.354241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.354773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.354773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.382426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:38.383615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:38.394171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e718a-09d2-4d61-b07f-a39f60db82af None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.394481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e718a-09d2-4d61-b07f-a39f60db82af None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.394770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e718a-09d2-4d61-b07f-a39f60db82af None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.396579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 193/381] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:38.403698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.403698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.403698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.404253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 189/382] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:38.426467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:38.428017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:38.437031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 194/383] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:38.439567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.450494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f59a04-b6ad-4d78-bd6f-17dba28fac53 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.459078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.459892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.460173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.460450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.477570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.481898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:38.489399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:38.490663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 190/384] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:38.492188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d646789-b6cc-4356-bd5a-6a3bb81885c4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.496670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.504085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.504884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.505161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.505428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.510431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d604c1-6f0b-41c8-8c56-2f8958c7a75c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.522405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.523071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.523348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.523614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.524384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:38.524686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.526315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.529264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:38.537016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:38.542345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 195/385] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:38.549339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 191/386] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:38.551348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.555538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.568032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba928680-fe9b-49ac-b04e-000795118f16 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.570572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c62b7e-1816-4336-87a7-f44f234417b7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.577523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.578201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.578484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.578760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.579522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:38.579825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.581974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.583879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.584716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.584988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.585258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.586520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.588398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.590214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 192/387] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:38.595775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.609073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 196/388] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:38.616602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ec9a-fff0-4a32-a06e-8d4f38ba81c4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.621226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.622067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.622370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.622649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.625497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.631911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.633995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.635760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 193/389] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:38.642125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e05c6-0edc-499e-8910-d360ece29b13 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.645679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.651268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.652118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.652392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.652662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.654043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.655981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.659151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c8b3-c21f-4b15-8c27-136367ddfc3a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.659885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 197/390] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:38.665836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.671706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091886d-672f-42bb-9e4e-cf31ec82bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.672591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091886d-672f-42bb-9e4e-cf31ec82bed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.672865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091886d-672f-42bb-9e4e-cf31ec82bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.673143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091886d-672f-42bb-9e4e-cf31ec82bed7 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8/groups/26349ee18267489a844714abe3fcfaee/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.679605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091886d-672f-42bb-9e4e-cf31ec82bed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1638968175244ce8a396b15be58b4e8, group_id=26349ee18267489a844714abe3fcfaee, role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.681273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f4aa7-2797-45d9-b96d-42c1f4d42cb7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.682311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091886d-672f-42bb-9e4e-cf31ec82bed7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.695185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.695185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.695645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.695810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.697237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.699008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.700963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 198/391] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:38 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:38.702902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 194/392] 10.222.0.57 () {58 vars in 1463 bytes} [Wed Dec 15 12:51:38 2021] PUT /identity/v3/projects/f1638968175244ce8a396b15be58b4e8/groups/26349ee18267489a844714abe3fcfaee/roles/fc97b407668046f9b05b539f70740d3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:38.708230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:38.727512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f73ef-4571-4282-ae09-58463fdd8ee1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:38.801533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07ddb8-928a-4a25-9afd-69427936a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:38.802561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ddb8-928a-4a25-9afd-69427936a3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.802844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ddb8-928a-4a25-9afd-69427936a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.803119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07ddb8-928a-4a25-9afd-69427936a3b9 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8/groups/26349ee18267489a844714abe3fcfaee/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.807690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07ddb8-928a-4a25-9afd-69427936a3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1638968175244ce8a396b15be58b4e8, group_id=26349ee18267489a844714abe3fcfaee, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:38.810449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07ddb8-928a-4a25-9afd-69427936a3b9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:38.831706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 199/393] 10.222.0.57 () {58 vars in 1463 bytes} [Wed Dec 15 12:51:38 2021] PUT /identity/v3/projects/f1638968175244ce8a396b15be58b4e8/groups/26349ee18267489a844714abe3fcfaee/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:38.842883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013998f5-da61-4d9d-8692-fb1b940d383c None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.843203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013998f5-da61-4d9d-8692-fb1b940d383c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.843432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013998f5-da61-4d9d-8692-fb1b940d383c None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.845386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 195/394] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:38.853456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:38.853739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:38.854031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:38.879134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:38.880418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:38.959761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 200/395] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:39.002363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013998f5-da61-4d9d-8692-fb1b940d383c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.020014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013998f5-da61-4d9d-8692-fb1b940d383c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.025326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.026206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.026493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.026768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.043001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:39.050507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:39.051890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 196/396] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:39.058449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.068689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e9032-dde6-4f29-8947-324ea4dc6241 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.075830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.076570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.076848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.077120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.078003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:39.078368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.080090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.090296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 201/397] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:39.096730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.108112 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002add2-26d7-46db-9da3-1d0762e65b37 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.114037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.115032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.115394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.115644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.118276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.120290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.122103 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 197/398] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:39.132345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.142878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1a77f-3aef-4493-8ff6-88843522e17e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.153300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b2411-e875-448a-9465-1ca0d273ba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.154263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2411-e875-448a-9465-1ca0d273ba0a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.154551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2411-e875-448a-9465-1ca0d273ba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.154825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b2411-e875-448a-9465-1ca0d273ba0a admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.156120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b2411-e875-448a-9465-1ca0d273ba0a admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.158280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b2411-e875-448a-9465-1ca0d273ba0a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.160717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 202/399] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:39.166538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.177045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fe5b3-6a02-47a7-830d-18768a198c46 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.183857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ce08b-4dbe-400c-a2d5-3480064eb1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.184657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce08b-4dbe-400c-a2d5-3480064eb1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.184934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce08b-4dbe-400c-a2d5-3480064eb1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.185209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ce08b-4dbe-400c-a2d5-3480064eb1c0 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54/groups/26349ee18267489a844714abe3fcfaee/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.188601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ce08b-4dbe-400c-a2d5-3480064eb1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7a8c4952924be399955938ffa1ac54, group_id=26349ee18267489a844714abe3fcfaee, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.191981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ce08b-4dbe-400c-a2d5-3480064eb1c0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.214708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 198/400] 10.222.0.57 () {58 vars in 1463 bytes} [Wed Dec 15 12:51:39 2021] PUT /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54/groups/26349ee18267489a844714abe3fcfaee/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:39.681098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de17cd-9aff-40f4-9e0d-2ccccb49681f None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.681098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de17cd-9aff-40f4-9e0d-2ccccb49681f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.681098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de17cd-9aff-40f4-9e0d-2ccccb49681f None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.682502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 203/401] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:39.686755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.687567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.688068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.710166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:39.711675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:39.775566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 199/402] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:39.802862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de17cd-9aff-40f4-9e0d-2ccccb49681f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.825696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de17cd-9aff-40f4-9e0d-2ccccb49681f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.833457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.834628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.835143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.835615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.858004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:39.865882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:39.867347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 204/403] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:39.873890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.884110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a715bc-2206-4723-9f06-2d80fd37f84a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.894377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.895318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.895836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.896557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.897535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:39.898046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.899881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.914277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 200/404] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:39.916501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.928115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4028953-a722-4844-b8fd-4d11a588625a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.934036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.935220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.935666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.936091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.937488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.939584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.941890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 205/405] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:39.948248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.958539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c558c98-97ee-4a40-912f-20c8b5841c46 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:39.966291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b597d-23d4-4886-aa79-4957fe8caa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:39.967358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b597d-23d4-4886-aa79-4957fe8caa88 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:39.967798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b597d-23d4-4886-aa79-4957fe8caa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:39.968233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b597d-23d4-4886-aa79-4957fe8caa88 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:39.969647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b597d-23d4-4886-aa79-4957fe8caa88 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:39.972452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b597d-23d4-4886-aa79-4957fe8caa88 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:39.975567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 201/406] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:39 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:39.980896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:39.991351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e33e7b-7ee4-4a86-ac91-e093ea5d2d6d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:40.000287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43da37-12a9-4496-8900-5b7568e412ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:40.001336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43da37-12a9-4496-8900-5b7568e412ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.001760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43da37-12a9-4496-8900-5b7568e412ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.002221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43da37-12a9-4496-8900-5b7568e412ee admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54/groups/26349ee18267489a844714abe3fcfaee/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.007984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43da37-12a9-4496-8900-5b7568e412ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7a8c4952924be399955938ffa1ac54, group_id=26349ee18267489a844714abe3fcfaee, role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:40.010857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43da37-12a9-4496-8900-5b7568e412ee admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:40.028497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 206/407] 10.222.0.57 () {58 vars in 1463 bytes} [Wed Dec 15 12:51:39 2021] PUT /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54/groups/26349ee18267489a844714abe3fcfaee/roles/fc97b407668046f9b05b539f70740d3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:40.632771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a93dc-9f66-48db-8401-6a019ab0061c None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.633326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a93dc-9f66-48db-8401-6a019ab0061c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.633756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a93dc-9f66-48db-8401-6a019ab0061c None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.635706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 202/408] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:40.643362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.643925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.644418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.671134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:40.672668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:40.742250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 207/409] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:40.762937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a93dc-9f66-48db-8401-6a019ab0061c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:40.778688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a93dc-9f66-48db-8401-6a019ab0061c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:40.784143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:40.785269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.786042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.786547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.798004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:40.805500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:40.812531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 203/410] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:40.815905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:40.826213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de318b-1e5c-4457-9f47-85cd7806a140 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:40.831851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:40.832733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.833214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.833688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.834705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:40.835210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:40.837049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:40.852147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 208/411] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:40.853774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:40.865236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b40c-354f-4021-96a8-962682fadba5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:40.870178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:40.871294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.871774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.872284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] PATH_INFO: `/v3/groups/18c4ea35ad2143cea8f574f7a0fff43a` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.873714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] RBAC: Authorizing `identity:get_group(group_id=18c4ea35ad2143cea8f574f7a0fff43a)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:40.875913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:40.877890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 204/412] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:40 2021] GET /identity/v3/groups/18c4ea35ad2143cea8f574f7a0fff43a => generated 229 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:40.884321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:40.895206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a0c42-c25a-4414-b220-7410fe1925fa admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:40.900030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a61ae-07fa-4508-ad16-df2f4073b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:40.901147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a61ae-07fa-4508-ad16-df2f4073b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.901682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a61ae-07fa-4508-ad16-df2f4073b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.902183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a61ae-07fa-4508-ad16-df2f4073b9eb admin admin] PATH_INFO: `/v3/projects/ce52653451e74d3f9f778f9e368425dc` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.903659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a61ae-07fa-4508-ad16-df2f4073b9eb admin admin] RBAC: Authorizing `identity:get_project(project_id=ce52653451e74d3f9f778f9e368425dc)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:40.905781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a61ae-07fa-4508-ad16-df2f4073b9eb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:40.907817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 209/413] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:40 2021] GET /identity/v3/projects/ce52653451e74d3f9f778f9e368425dc => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:40.914657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:40.925799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef276-4c10-4e13-9136-e03de550a34e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:40.932241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40beee1-a6fa-456c-ae1c-269b252dadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:40.933526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40beee1-a6fa-456c-ae1c-269b252dadca admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:40.934064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40beee1-a6fa-456c-ae1c-269b252dadca admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:40.934572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40beee1-a6fa-456c-ae1c-269b252dadca admin admin] PATH_INFO: `/v3/projects/ce52653451e74d3f9f778f9e368425dc/groups/18c4ea35ad2143cea8f574f7a0fff43a/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:40.938941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40beee1-a6fa-456c-ae1c-269b252dadca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce52653451e74d3f9f778f9e368425dc, group_id=18c4ea35ad2143cea8f574f7a0fff43a, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:40.942270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40beee1-a6fa-456c-ae1c-269b252dadca admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:40.962306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 205/414] 10.222.0.57 () {58 vars in 1463 bytes} [Wed Dec 15 12:51:40 2021] PUT /identity/v3/projects/ce52653451e74d3f9f778f9e368425dc/groups/18c4ea35ad2143cea8f574f7a0fff43a/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:41.880759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31635-023f-4637-b2bf-a4374060e73d None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:41.881274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31635-023f-4637-b2bf-a4374060e73d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:41.881377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb31635-023f-4637-b2bf-a4374060e73d None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:41.883432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 210/415] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:41.890494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:41.891472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:41.891982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:41.912635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:41.914343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:41.956335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025b01-2474-44ec-9378-c6dca023168c None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:41.956665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025b01-2474-44ec-9378-c6dca023168c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:41.956883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025b01-2474-44ec-9378-c6dca023168c None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:41.962951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 211/416] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:41 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:41.972696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:41.972973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:41.973246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:41.981536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 206/417] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:41.994839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:41.996013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:42.009809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 212/418] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:42.013652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.024662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde04c7e-483b-459f-8534-ea5f83fa63c7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.030708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.031785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.032280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.032789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.045093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:42.052576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:42.058057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.058390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 207/419] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:42.060906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.064561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34436128-4c52-4b57-8e48-abd739b503bf None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.072002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e324296-a416-4126-bc97-7dba7773026f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.077079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.077795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.078293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.078638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.078915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.079186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.079409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.079874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.081561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:42.082080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.083988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.098288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 208/420] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:42.101396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.101510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:42.111733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6083f0-595b-4073-a9c3-f43730c74811 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.116187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:42.117840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 213/421] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:42.118438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.119662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.120153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.120664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.124481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.130932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.132945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.136905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce604c7-191b-41e2-8033-79627b33d561 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.142772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 209/422] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:42.150962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.151966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.152447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.152954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.154041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:42.154584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.156438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.162814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.172152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87cd68-7f24-4912-a913-6425e0ce3147 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.182037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 214/423] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:42.190948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.191286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.191882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.192117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.192391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.193644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.195739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.197685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 210/424] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:42.206647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd188-53ab-414c-9681-5bc591e97d57 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.212907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.213646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.214093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.214460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.214686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.226453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.230977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.232274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eb6fd-8113-44db-9d77-a4e4833186fe admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.246476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.247457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.247782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.248089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.249470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 215/425] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:42.250203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.252149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.254527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 211/426] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:42.255981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.260350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.268172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dc031-cab2-4265-9aab-eff6e2fbb85e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.279180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.280872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f7d00-7e1d-4dbb-8e03-a7e3702932ae admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.281633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.282201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.282714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.286978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.293086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.295065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.297389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.297859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.298913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.300555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 216/427] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:42.301555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=f1638968175244ce8a396b15be58b4e8) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:42.302366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.304605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.306656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.318325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 212/428] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 611 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:42.318863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044c3a0-7244-4a38-832a-31cbb2431f4c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.324169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229348a-c9b5-4247-9cd4-40494fcb1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.325406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229348a-c9b5-4247-9cd4-40494fcb1c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.325885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229348a-c9b5-4247-9cd4-40494fcb1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.326399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229348a-c9b5-4247-9cd4-40494fcb1c72 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.329498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229348a-c9b5-4247-9cd4-40494fcb1c72 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.332577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229348a-c9b5-4247-9cd4-40494fcb1c72 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.335094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 217/429] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:42.340982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.352040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1939d83-5226-4700-b1ca-af40fb26658d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.357165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.358050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.358595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.359054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.360139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=f1638968175244ce8a396b15be58b4e8) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:42.360628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.363598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e4ec-1e44-4661-94d8-8ba4dcd8e9b7 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.363899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e4ec-1e44-4661-94d8-8ba4dcd8e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.364291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107e4ec-1e44-4661-94d8-8ba4dcd8e9b7 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.364409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.366535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 218/430] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:42.372460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 213/431] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=f1638968175244ce8a396b15be58b4e8&role.id=fc97b407668046f9b05b539f70740d3d => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:42.372891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.373316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.373661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.394302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:42.395988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:42.405339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 219/432] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:42.432184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.444236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7807c4-4ac1-4aaf-8db9-98f0318a445f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.450133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.451343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.451870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.452324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.468674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:42.476463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 15 12:51:42.480921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 214/433] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:42.485876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.504980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87a7d6-c7ac-438d-b416-586ec99b08b2 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.514710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.515522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.515874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.516303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.517161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:42.517530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.519792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.534588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 220/434] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:42.541535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.559879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5154-572e-4ca2-a934-ca6a1358bc8c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.569116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.570182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.570673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.571173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.581638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.583978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.596693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 215/435] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:42.602729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.616211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8741a-8f41-45eb-a6a3-097ddf138f99 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.621326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.622615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.623144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.623636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.625238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.628680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.633056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 221/436] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:42.636841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.647107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdce45-a63e-4eca-8f08-16b5fd19a7a5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.654801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d8132-56e2-48d8-b256-650847ea61ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.655968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d8132-56e2-48d8-b256-650847ea61ed admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.656456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d8132-56e2-48d8-b256-650847ea61ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.656932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d8132-56e2-48d8-b256-650847ea61ed admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.659135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d8132-56e2-48d8-b256-650847ea61ed admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.661610 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d8132-56e2-48d8-b256-650847ea61ed admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.664026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 216/437] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:42.670007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:42.683657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7675-0f9a-4487-aaf7-8e983f072412 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:42.692587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:42.693265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:42.693544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:42.693817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:42.694703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=864e7e8eaded488ba7be82618e54cf49, scope.project.id=ca7a8c4952924be399955938ffa1ac54) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:42.695014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:42.696899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550ed29-d2a6-40bb-a756-52cf571c8a4a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:42.708399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 222/438] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:42 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=864e7e8eaded488ba7be82618e54cf49 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:43.525301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f82f-4b3f-4f92-88b3-b37d665760d2 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.525836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f82f-4b3f-4f92-88b3-b37d665760d2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.525836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f82f-4b3f-4f92-88b3-b37d665760d2 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.527687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 217/439] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:43.534732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.535265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.535265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.554466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:43.555685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:43.563365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 223/440] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:43.587008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f82f-4b3f-4f92-88b3-b37d665760d2 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:43.599299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f82f-4b3f-4f92-88b3-b37d665760d2 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:43.603477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:43.604249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.604527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.604795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.614804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:43.621982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:43.623292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 218/441] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:43.629588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:43.638390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0a648-c851-4e81-a150-df97aa899c82 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:43.642699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:43.643435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.643714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.643986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.644742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:43.645071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:43.646685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:43.654892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 224/442] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:43.661790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:43.671345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ffba-5828-409c-97e4-f43b044aab03 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:43.675687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:43.676304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.676587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.676863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.684887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:43.686665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:43.695782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 219/443] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:43.701726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:43.711778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f171a6-8503-4c2d-a568-aa70486657dd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:43.716075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:43.716900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.717181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.717449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] PATH_INFO: `/v3/projects/ca7a8c4952924be399955938ffa1ac54` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.718652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] RBAC: Authorizing `identity:get_project(project_id=ca7a8c4952924be399955938ffa1ac54)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:43.720671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:43.722294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 225/444] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/projects/ca7a8c4952924be399955938ffa1ac54 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:43.728160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:43.736801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59804b7c-60c8-4ebe-ae33-d01075a7d0e8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:43.741107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829da15-4ccf-4229-b34d-6891394620f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:43.741928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829da15-4ccf-4229-b34d-6891394620f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.742234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829da15-4ccf-4229-b34d-6891394620f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.742504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829da15-4ccf-4229-b34d-6891394620f9 admin admin] PATH_INFO: `/v3/groups/26349ee18267489a844714abe3fcfaee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.743686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829da15-4ccf-4229-b34d-6891394620f9 admin admin] RBAC: Authorizing `identity:get_group(group_id=26349ee18267489a844714abe3fcfaee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:43.745572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829da15-4ccf-4229-b34d-6891394620f9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:43.747133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 220/445] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/groups/26349ee18267489a844714abe3fcfaee => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:43.753444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:43.762612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed46be-1fb0-41ed-bd73-ea1121c2c632 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:43.766873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:43.767483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.767760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.768594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.769421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] RBAC: Adding query filter params (group.id=26349ee18267489a844714abe3fcfaee, role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=ca7a8c4952924be399955938ffa1ac54) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:43.769729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:43.771560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff55795-da06-40ed-a973-88716b163aef admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:43.777217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 226/446] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/role_assignments?group.id=26349ee18267489a844714abe3fcfaee&scope.project.id=ca7a8c4952924be399955938ffa1ac54&role.id=fc97b407668046f9b05b539f70740d3d => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:43.933373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544108-48ab-4960-a5c4-45ec54d8e594 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.933654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544108-48ab-4960-a5c4-45ec54d8e594 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.933925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa544108-48ab-4960-a5c4-45ec54d8e594 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.935781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 221/447] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:43.942016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c47b-0590-44ff-9265-128669865029 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:43.942322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c47b-0590-44ff-9265-128669865029 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:43.942593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c47b-0590-44ff-9265-128669865029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:43.960959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-7368c47b-0590-44ff-9265-128669865029 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:43.962187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-7368c47b-0590-44ff-9265-128669865029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:43.969586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 227/448] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:43.993152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544108-48ab-4960-a5c4-45ec54d8e594 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:44.005979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa544108-48ab-4960-a5c4-45ec54d8e594 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:44.010295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:44.011060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:44.011341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:44.011614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:44.021920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:44.028853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:51:44.029966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 222/449] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:44.036493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368c47b-0590-44ff-9265-128669865029 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:44.045614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368c47b-0590-44ff-9265-128669865029 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:44.050640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:44.051295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:44.051573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:44.051843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:44.052599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:44.052900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:44.054519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:44.062858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 228/450] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:44.068787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:44.078578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54184a7-308f-483e-9cd2-9235197b9151 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:44.083521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:44.084143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:44.084417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:44.084686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:44.093920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:44.095679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:44.104497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 223/451] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:44.110573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:44.120506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785661bb-d5d1-42ab-afce-36a4fa4d34d5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:44.126957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:44.127974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:44.128286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:44.128586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] PATH_INFO: `/v3/projects/ce52653451e74d3f9f778f9e368425dc` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:44.129772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce52653451e74d3f9f778f9e368425dc)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:44.131642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:44.133310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 229/452] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:51:44 2021] GET /identity/v3/projects/ce52653451e74d3f9f778f9e368425dc => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:44.139283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:44.152516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db99ae9-e646-4bf2-ad3a-e8eba6e6b44f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:44.156918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225047b-6e72-43f4-b9b5-3188a39bd94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:44.157747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225047b-6e72-43f4-b9b5-3188a39bd94a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:44.158019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225047b-6e72-43f4-b9b5-3188a39bd94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:44.158319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225047b-6e72-43f4-b9b5-3188a39bd94a admin admin] PATH_INFO: `/v3/groups/18c4ea35ad2143cea8f574f7a0fff43a` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:44.160053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225047b-6e72-43f4-b9b5-3188a39bd94a admin admin] RBAC: Authorizing `identity:get_group(group_id=18c4ea35ad2143cea8f574f7a0fff43a)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:44.162204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225047b-6e72-43f4-b9b5-3188a39bd94a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:44.163944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 224/453] 10.222.0.57 () {56 vars in 1201 bytes} [Wed Dec 15 12:51:44 2021] GET /identity/v3/groups/18c4ea35ad2143cea8f574f7a0fff43a => generated 229 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:44.169919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:44.179781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c32c9-548d-473e-bb3e-3c7e831a5c02 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:44.184089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:44.184762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:44.185057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:44.185336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:44.186251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] RBAC: Adding query filter params (group.id=18c4ea35ad2143cea8f574f7a0fff43a, role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=ce52653451e74d3f9f778f9e368425dc) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:44.186563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:44.188389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f2b60-6cab-47ea-933a-ccfb1a480c32 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:44.194680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 230/454] 10.222.0.57 () {56 vars in 1397 bytes} [Wed Dec 15 12:51:44 2021] GET /identity/v3/role_assignments?group.id=18c4ea35ad2143cea8f574f7a0fff43a&scope.project.id=ce52653451e74d3f9f778f9e368425dc&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:47.125884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff1cbd-6c3a-4352-b7ca-97f4627923d6 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.126393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff1cbd-6c3a-4352-b7ca-97f4627923d6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.126393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff1cbd-6c3a-4352-b7ca-97f4627923d6 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.128495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 225/455] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:47.134424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.134848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.135041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.159200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:47.160656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:47.172624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 231/456] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:47.199391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff1cbd-6c3a-4352-b7ca-97f4627923d6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.215675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff1cbd-6c3a-4352-b7ca-97f4627923d6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.220140 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.221442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.221716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.221985 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.236460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.238395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.261568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-6c880f55-6526-4cf0-ad52-a7b1eca669f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:47.262970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 226/457] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:47.269177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.274736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315be9-8fd1-4e2b-94b0-1164e0db8afa None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.275014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315be9-8fd1-4e2b-94b0-1164e0db8afa None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.275284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a315be9-8fd1-4e2b-94b0-1164e0db8afa None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.277174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 227/458] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:47.278652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242de15-cdcf-4485-89aa-5e001d1e1e80 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.282791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.283072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.283880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.292595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.293261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.293538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.293808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.294568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:47.294871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.295892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:47.295892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:47.295892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:47.297207 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137ee5-322e-4c67-91e7-98a595f9e20d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.301927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:47.303138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:47.311181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 228/459] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:47.321323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 232/460] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:47.327046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.334229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dc0cf-dd99-41c7-8e2d-91284b0afe5f None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.334516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dc0cf-dd99-41c7-8e2d-91284b0afe5f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.334785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113dc0cf-dd99-41c7-8e2d-91284b0afe5f None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.336481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 233/461] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:47.339766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcff1c-14db-4e08-8aee-235c83de8de4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.344208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76462db9-4217-4692-9fbe-be521f7a93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.344868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76462db9-4217-4692-9fbe-be521f7a93fd admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.345143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76462db9-4217-4692-9fbe-be521f7a93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.345408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76462db9-4217-4692-9fbe-be521f7a93fd admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.346691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76462db9-4217-4692-9fbe-be521f7a93fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.348585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76462db9-4217-4692-9fbe-be521f7a93fd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.349735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dc0cf-dd99-41c7-8e2d-91284b0afe5f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.361967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113dc0cf-dd99-41c7-8e2d-91284b0afe5f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.369192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.370154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.370447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.370888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.378336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 229/462] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/users => generated 246 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:47.379804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.380275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.380766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.391064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.393603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.401142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:47.402703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:47.411523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 230/463] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:47.425561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:47.427163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 234/464] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:47.434388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.449767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ca3a-2e98-4873-a826-2a5e84cc85a7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.463586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.464399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.465432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.465892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.466379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.467318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:47.467842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.469668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.478980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c298b-9bbc-4480-af10-69f5991e3109 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.486135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 231/465] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:47.494643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.495563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.495845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.496197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.496851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.511565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a4282-a23f-45b9-8d69-96c09ab00140 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.513578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.515523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.516940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.518418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.519100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.519557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.520489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.522623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.545407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 232/466] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/users => generated 248 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:51:47.550229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:47.550229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 235/467] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:47.559723 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.571709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c522d09-825c-4ec3-a8c2-bef155da5f7b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.576972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.578003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.578517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.579093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.580152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:47.580709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.582649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad666c2-4d9b-4ad6-9fca-6a7bec8ca387 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.598241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 233/468] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:47.607939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.620623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69764-e4d3-4e56-9c81-6363a7aa2c31 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.633077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5ec08-8ce0-4dc6-ac61-32033e371d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.633838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ec08-8ce0-4dc6-ac61-32033e371d89 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.634119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ec08-8ce0-4dc6-ac61-32033e371d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.634416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5ec08-8ce0-4dc6-ac61-32033e371d89 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.635170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5ec08-8ce0-4dc6-ac61-32033e371d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.637190 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5ec08-8ce0-4dc6-ac61-32033e371d89 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:47.677443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 236/469] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/users => generated 248 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:47.882007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7892e5-5662-4a81-b36f-cd038f1aeeea None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.882518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7892e5-5662-4a81-b36f-cd038f1aeeea None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.882881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7892e5-5662-4a81-b36f-cd038f1aeeea None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.885170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 234/470] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:47.891554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.891887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.892103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.915810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:47.918021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:47.933849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 237/471] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:47.958320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7892e5-5662-4a81-b36f-cd038f1aeeea None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:47.974019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7892e5-5662-4a81-b36f-cd038f1aeeea None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:47.979865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:47.980681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:47.980956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:47.981227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:47.995540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:47.997395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:48.017254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:48.022279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 235/472] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:48.025061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:48.035124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f340da8-32d0-49c6-bb99-74bac7ff9efd None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:48.040146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:48.040982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.041411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.041853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.042767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:48.043231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:48.044977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc41ae-9c89-4a93-a51c-596e15cdd2d3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:48.062283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 238/473] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:48.064958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:48.075070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616efc5-a1c8-46ad-9aee-291e9e982578 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:48.079737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c591b9-ec60-4ae0-b2e3-13880855775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:48.080601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c591b9-ec60-4ae0-b2e3-13880855775d admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.081030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c591b9-ec60-4ae0-b2e3-13880855775d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.081462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c591b9-ec60-4ae0-b2e3-13880855775d admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.082438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c591b9-ec60-4ae0-b2e3-13880855775d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:48.084573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c591b9-ec60-4ae0-b2e3-13880855775d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:48.111326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 236/474] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:48 2021] POST /identity/v3/users => generated 249 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:48.422915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676bd43-0e91-42d6-93c3-cc3b9f042e03 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.423458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676bd43-0e91-42d6-93c3-cc3b9f042e03 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.423458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676bd43-0e91-42d6-93c3-cc3b9f042e03 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.426074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 239/475] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:48.431809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.432231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.432402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.453629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:48.454891 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:48.467119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 237/476] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:48.491311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676bd43-0e91-42d6-93c3-cc3b9f042e03 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:48.504855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676bd43-0e91-42d6-93c3-cc3b9f042e03 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:48.509361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:48.510244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.510694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.511134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.512088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:48.513853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:48.522168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.sql.core [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 15 12:51:48.522168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 15 12:51:48.522168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [parameters: {'id': '110a983496664f8fbeb13f03a2817e84', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 15 12:51:48.522168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79109) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 12:51:48.537753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 15 12:51:48.539812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 240/477] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 12:51:48 2021] POST /identity/v3/roles => generated 144 bytes in 49 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:48.546208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:48.556708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d93d6a-c849-4ec4-b11e-86d32c91b912 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:48.561604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25e3d4-14ac-4a7e-9494-0b028a9b134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:48.562735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e3d4-14ac-4a7e-9494-0b028a9b134c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.563187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e3d4-14ac-4a7e-9494-0b028a9b134c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.563674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e3d4-14ac-4a7e-9494-0b028a9b134c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.575043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25e3d4-14ac-4a7e-9494-0b028a9b134c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:48.583613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ba25e3d4-14ac-4a7e-9494-0b028a9b134c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 15 12:51:48.585306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 238/478] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:51:48 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:48.591816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:48.603620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225123-0a38-465c-812f-ed06b87e0622 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:48.608356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:48.609255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:48.609729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:48.610192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:48.611882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:48.612560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:48.614935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021c1b-7261-43b3-b5d6-63ae603c0994 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:48.625272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 241/479] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:48 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.277200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb4ed-34f1-40f7-a8fa-f74ff3e43f60 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.277735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb4ed-34f1-40f7-a8fa-f74ff3e43f60 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.277735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cb4ed-34f1-40f7-a8fa-f74ff3e43f60 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.279975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 239/480] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:50.286922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.287869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.288335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.313765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:50.315905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:50.328557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 242/481] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:50.364799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb4ed-34f1-40f7-a8fa-f74ff3e43f60 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.391839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cb4ed-34f1-40f7-a8fa-f74ff3e43f60 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.400596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.401800 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.402079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.402382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.420224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:50.427775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:50.433862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 240/482] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:50.435134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.452616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c142dd-3fa4-43bb-8c3d-23119a354598 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.462292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.462971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.463250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.463523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.464292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:50.464598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.466216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.481472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 243/483] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.487685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.503232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123cfb6-a1f7-487e-bb32-f10898be407e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.513922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.514732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.515013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.515286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.534935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.536989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.562828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-d7900d7b-9296-4648-851d-e3e2b0e0eb6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:50.564434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 241/484] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:50.572152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.587193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2a3ae-b512-4318-8857-d3c306b6ab3d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.593235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03f78-5f43-4029-a813-f914a6e477cf None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.593736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03f78-5f43-4029-a813-f914a6e477cf None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.594258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd03f78-5f43-4029-a813-f914a6e477cf None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.597030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 242/485] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:50.599348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.600065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.600381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.600656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.601415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:50.601722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.603412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.603945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.604432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.605120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.632343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 244/486] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.633627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:50.635070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:50.643314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.655258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e4e49-9211-4b44-b206-01bbcef35d98 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.658217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 243/487] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:50.662107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.662914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.663192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.663463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.671539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.673553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.688118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:51:50.689696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 245/488] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:50.695785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.702719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.711798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d069-3bb8-458c-a0e1-b59f939cfc94 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.715369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdf8bd-ee5a-430c-af5c-b2cbec6bdc1e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.716215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.716890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.717168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.717439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.718328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:50.718641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.719709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:50.719709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:51:50.719709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:51:50.721399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.726490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.727609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.728161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.728645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.755121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:50.761202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 244/489] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.762670 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:50.769654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 246/490] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:50.770704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.770810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.789620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738e3a5-db6a-4487-b9b9-8246636bfc2e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.792100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665944f-28fa-4a75-b532-98f321fa51a5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.800117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.800935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.801666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.812701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.813275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.813779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.814895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.815330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.816614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:50.819371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.821161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.832529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.835352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.844449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 245/491] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.846963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 247/492] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:50.852912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.853276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.862549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9499de-6b7b-4b37-8289-43e94e66707d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.867996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.868929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.869349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.869763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.872508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689638c-950a-4151-833e-7cf1313a1c5f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.877065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.877841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.878121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.878426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.882386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.884401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.889683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.891606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.904895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a8dce02a-dacc-4abc-9362-234a2618a278 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:50.906611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 248/493] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:50.913470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3ffd3-587b-4e4e-9d92-a859802eca4b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.913598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:50.913598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 246/494] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:50.914174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3ffd3-587b-4e4e-9d92-a859802eca4b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.914599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3ffd3-587b-4e4e-9d92-a859802eca4b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.914769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.916875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 249/495] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:50 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:50.917726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3ffd3-587b-4e4e-9d92-a859802eca4b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.925159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4bd3-afec-4ab4-a1c9-865a3c5c09a1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.930659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.931355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3ffd3-587b-4e4e-9d92-a859802eca4b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.931485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.931859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.932228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.933169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:50.933569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.935301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30435682-9d6a-46e0-a284-12d867d3e932 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.936758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.937694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.938599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.939019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.940407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:50.940849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.942583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.951814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 247/496] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.956843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.956843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.956843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.960425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 250/497] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:50.961583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:50.975523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:50.976449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591c1b1-6d06-4112-b2df-b732b6633c4d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:50.976706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:50.981408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:50.982480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:50.982911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:50.983328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:50.985694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 248/498] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:50.991544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:50.993815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:50.995223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.016641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8ec9-aa47-4f56-9869-7a3c93462fce None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.022027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:51.024486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 251/499] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.030206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.030206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.030206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.030206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.031618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.035757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.037773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.047085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de2c80-04c9-4c6f-b7a3-accf2a25f382 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.053074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.053863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.054138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.054435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.057053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 12:51:51.058866 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 249/500] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:50 2021] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.059653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.075294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42f0d8-f5f8-48d2-9b0e-45fda9fd82e7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.075687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:51.080661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.081398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.081856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.082225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.083150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.083521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.083978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:51.084691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:51.084691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:51:51.084691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:51:51.085173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 252/501] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.085928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.086027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.100655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562665-df48-4e77-b74d-6627433c7443 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.105036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.105642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 250/502] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.105803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.105919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.106228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.107143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.107445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.108460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:51.108460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:51.108460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:51.109575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.111682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.121429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f89b-9dc3-4d30-9797-a6b86b703bc2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.126060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.127321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.127652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.127996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.128854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.129226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.131311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.139874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 251/503] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.140748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.150691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e20b70-687b-4bf8-9b36-82da6522d4d7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.154341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 253/504] 10.222.0.57 () {56 vars in 1158 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.158968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.160975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.161622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.161900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.162199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.163161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6b2623b20f16432d986a95fc400d52b6) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.163464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.165311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.171481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 252/505] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/role_assignments?user.id=6b2623b20f16432d986a95fc400d52b6&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.172062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.172328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b0ed5-4106-47e5-88c4-0f62e643e8ca admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.186245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.188742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.190566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.192437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.206873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8082da0-6f6e-42a6-ad62-96706535a30a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.215943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.216601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.216877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.217147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.217349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.219453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.239463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:51.240742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 254/506] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.242324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.244158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.246984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.257966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6703655-1796-4705-bcf3-7614cbfdb02e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.262875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 253/507] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:51.267063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.267913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.268197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.268469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.269229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.269534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.271410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.276581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.288647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429928-986f-4b3d-a56a-37d3fbaf386c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.291459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 255/508] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:51.297406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.302879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.303692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.303972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.304247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.307743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26df0b-467f-41e1-b241-5a660e3da667 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.313245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.314455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.314932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.315381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.325282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.327853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.331695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.333546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.344137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 12:51:51.345802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 256/509] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:51.353237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.363550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:51.364822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 254/510] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:51.365212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464410a-ed18-4914-b34d-a2a6ada4c8e2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.370708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.371798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.372299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.372772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.373919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.374470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.375182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.377136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.393244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd7c5f-66c0-4616-b062-26950d1e7810 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.400647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 257/511] 10.222.0.57 () {56 vars in 1158 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.407350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.408485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.409249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.409533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.409809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.410850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.411154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.412745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.419767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006182-c0a3-49d3-9662-5eea20c40e32 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.426048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.426966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.427468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.427920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.441013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 255/512] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.443429 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.445519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.446804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.463979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a3469-a6f9-44c2-850e-1c23806dca26 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.469754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 258/513] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:51.477368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.478517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.479006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.479460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.483957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.492464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.494518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.495886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8772f3-9fa2-4677-8ea4-ab05e9464f79 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.500737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.501718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.502273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.502725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.508495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e929b1b0-5a58-4aed-83b2-772122f7c49d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:51.510285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 256/514] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.514117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.516138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1c0a-859a-43ae-a6c5-24556bccf1c2 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.516417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1c0a-859a-43ae-a6c5-24556bccf1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.516687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e1c0a-859a-43ae-a6c5-24556bccf1c2 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.517052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.519207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 257/515] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:51 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:51.519912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1c0a-859a-43ae-a6c5-24556bccf1c2 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.536556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-582d3933-197f-4546-b161-57f5d108ef79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:51.537445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e1c0a-859a-43ae-a6c5-24556bccf1c2 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.538637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 259/516] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:51.544639 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.544639 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.544639 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.546808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.547552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.547779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.548048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.549386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.549686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.551574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.564116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 258/517] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.565061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.568543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:51.569999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:51.580803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d597f2-ad88-4346-b1a0-a60dcd66b8a5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.581377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 260/518] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:51.583292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.594348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc396b2-ccdf-41f9-ae7f-7086bf77c69e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.595946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.596791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.597075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.597357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.598074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.598415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.600321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.601287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.602195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.602727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.603310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.604456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=bb7c470fd2684be89d1821f2abb36406) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.605030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.607238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.614275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 261/519] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/role_assignments?user.id=bb7c470fd2684be89d1821f2abb36406&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.625907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 259/520] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.627812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.638681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb431-b0c8-4383-8b51-fc9a8a54ced3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.644160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.645273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.645803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.647472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.654235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.659468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adaac7-6c71-4dc0-bd72-dd4c187f1d5b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.673478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:51.681563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:51.682904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.683717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.684090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.684293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.684497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 262/521] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.691699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.699486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.701486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.703329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc5db-ddbd-4ccf-92eb-4e5fcd6fcecd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.708541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.709632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.710120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.710767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.711827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.712380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.714421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.725282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 263/522] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:51.731684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.733341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:51.734984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 260/523] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:51.740695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.743589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc321d1-0080-4ac1-a4d5-f6b3261ff798 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.748664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.749886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.750425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.750915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.763443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.765768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.768834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a990d2-9f9e-41aa-ba9f-f35513e514f3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.787080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:51.788787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 264/524] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:51.795204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.795377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.796006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.796291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.796562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.797494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.797854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.800013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094e6c4-3ab7-40fc-b64b-583537405ba5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.807471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6f063-baa8-46ac-a3d7-356fcf5f3a68 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.813067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.813964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.815021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.815522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.816473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.816977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.818921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea84b2-d856-4894-8b07-057cd1a8200c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.824454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 261/525] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:51.825644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b437e-3909-4b6e-af6e-24b3a8181fed None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.825930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b437e-3909-4b6e-af6e-24b3a8181fed None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.826234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b437e-3909-4b6e-af6e-24b3a8181fed None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.827973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 262/526] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:51.833398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 265/527] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.833585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b437e-3909-4b6e-af6e-24b3a8181fed None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.835459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.835961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.836509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.847268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b437e-3909-4b6e-af6e-24b3a8181fed None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.852533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.853192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.853474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.853747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.854785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=77e852bb87284a4c9bd820d088bcb759) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.855147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.857184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.858300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:51.859826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:51.866203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 263/528] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/role_assignments?user.id=77e852bb87284a4c9bd820d088bcb759&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:51.866952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.868717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 266/529] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:51.885499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b4fef-86af-4af7-95a9-10c9a8286f7d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.894946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.895764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.896054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.896363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.897449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.905817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.908034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.914186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cfafb-cd16-446b-92ef-cf62eecaca87 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.920953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.922216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.922700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.923252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.923823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 12:51:51.925556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 264/530] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:51.931590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:51.945812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.948020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.950937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191917-42b8-4c89-90c8-3919381a932d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:51.962917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:51.963895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:51.966022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:51.966512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:51.967554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:51.969013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:51.971660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:51.981206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:51.989353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 267/531] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:52.004956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.013990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 265/532] 10.222.0.57 () {56 vars in 1160 bytes} [Wed Dec 15 12:51:51 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:52.017944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc163ee3-4d2f-42b7-87ce-0e9051f5fd6d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.020406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.029383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.030368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.030789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.031200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.032109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:52.035033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.037145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.042756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60308528-a45c-484f-b2b9-6a46f0a80b15 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.053296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.055900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.056390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.056810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.061392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 268/533] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:52.069374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.070663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.070943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.081835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 266/534] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:52.087289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5855a2-1ab9-4105-909c-a180798e45bd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.089258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.103427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.104111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.104220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ede86-4d09-4442-a625-60e56e874b34 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.105169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.105832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.107011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.109881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.114991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.115833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.116107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.116373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.137461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 269/535] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:51:52 2021] POST /identity/v3/users => generated 247 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:51:52.145408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.147634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.186173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:52.187885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 267/536] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:52.194248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.212693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf932d-360b-4520-aedd-26123344ace5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.220922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.221656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.221935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.222227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.223034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:52.223380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.225091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.248983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 270/537] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:52.255430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.275661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963dfac-9fcc-4381-beaf-dcf0df16040f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.291941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.293569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.294057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.294596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.308282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.310643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.331350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:52.332945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 268/538] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:52.339350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.357798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac245d5-0988-4dcd-a2c6-5a4ac23f6769 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.368673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.369382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.369661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.369930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.370769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:52.371073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.372086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:51:52.372086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:51:52.372086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:51:52.373220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3a33-2891-4e31-a901-31b8bddebb80 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.400157 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 271/539] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:52.406922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:52.424370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14d4f-ef79-4123-9fd9-30f5d341e7a9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:52.429180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:52.429824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:52.430104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:52.430421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:52.431267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6300d566628547b48cbe60769799c1bf) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:52.431576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:52.433436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39db7a-28b1-425e-9199-8bc7c9f0b9d5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:52.446308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 269/540] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:52 2021] GET /identity/v3/role_assignments?user.id=6300d566628547b48cbe60769799c1bf&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:54.225451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68818-3e13-4def-9091-6296f2b27065 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.226519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68818-3e13-4def-9091-6296f2b27065 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.227007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe68818-3e13-4def-9091-6296f2b27065 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.229220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 272/541] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:54.235393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.236306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.236804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.262283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:54.263836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:54.276591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 270/542] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:54.309516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68818-3e13-4def-9091-6296f2b27065 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.328203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe68818-3e13-4def-9091-6296f2b27065 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.336653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3820ca-cc1e-415f-9c3e-bbcd13719716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.337679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3820ca-cc1e-415f-9c3e-bbcd13719716 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.338178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3820ca-cc1e-415f-9c3e-bbcd13719716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.338652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3820ca-cc1e-415f-9c3e-bbcd13719716 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.352025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3820ca-cc1e-415f-9c3e-bbcd13719716 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:54.359223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-2e3820ca-cc1e-415f-9c3e-bbcd13719716 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:54.360939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 273/543] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:54.367350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.376762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb3e7-1192-40ba-a88d-5e43e3bfbfef None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.383759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ad63-05b9-4f4a-a0f5-247bdc7985f5 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.384068 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ad63-05b9-4f4a-a0f5-247bdc7985f5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.384323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ad63-05b9-4f4a-a0f5-247bdc7985f5 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.386585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 274/544] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:54.392034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.393352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.393636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.393907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.394355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.394836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.395441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.396472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.396988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.398900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.416646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:54.417751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 271/545] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:54.417861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:54.424248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.427620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 275/546] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:54.447340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8651d-2768-4e8b-aac1-3336a278956f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.452539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.462748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80ecb5-317d-4b41-bbbc-9a7f1d43f0d9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.462877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.463655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.463934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.464201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.468575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.469345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.469620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.469885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.485516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.487835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.491047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:54.498115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:54.499623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 276/547] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:54.506348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.523662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:54.529803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846fba3-e385-4a49-a08d-c706c71e14d4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.531456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 272/548] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:54.532296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.540309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.540972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.541253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.541523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.542316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.542615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.544217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.555360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6db5-4b16-4a7f-b738-fd2d997dcfa9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.561101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 277/549] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:54.566798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.567459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.567739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.568012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.568750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.569059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.570671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.572132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.588051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e6999-a1c9-415d-a512-4688c7f6e156 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.595743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 273/550] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:54.597023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.597808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.598083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.598382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.602301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.618697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280b136-d981-4089-8edf-f17e0cf230ea admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.620069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.621938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.635774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.636583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.636864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.637141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.645936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.647627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:54.648123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.649139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 278/551] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:54.655398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.662559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:51:54.663914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 274/552] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:54.667782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77993cd-31b1-4338-b5b5-e1c6b4cd39a1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.669924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.684116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.684830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.685153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.685436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.686198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.686509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.689081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.692376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc2b4e-764e-4e2e-bf29-53b394f2e7be admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.704549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.705628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.706110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.706616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.707678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.708183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.710276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.715954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 279/553] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:54.722858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.741850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133041f4-194f-4628-a076-fabb105d322d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.748321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 275/554] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:54.751337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.752959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.753439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.753986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.755893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.770444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.773437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e10e1f-a104-48f9-82c0-897714dee221 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.775592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.787657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.788841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.789402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.789871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.804998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 12:51:54.806560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 280/555] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/users/glance => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:54.816078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.818197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.824195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.829357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7265491-d7cc-4efa-a6f7-d6de6fdd7fa8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.834411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.834888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.835288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.835675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.836687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.837006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.839063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238eff01-7289-4b07-b703-abd667d44d6d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.859681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:54.862203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 276/556] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:54.867027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.878669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 281/557] 10.222.0.57 () {56 vars in 1158 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:54.881045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8c481-efea-417f-9dfc-6c14c6048dfd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.882082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280078de-fb2b-4781-8b6f-739ca41be40f None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.882505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280078de-fb2b-4781-8b6f-739ca41be40f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.883054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280078de-fb2b-4781-8b6f-739ca41be40f None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.884977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 282/558] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:54.885530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280078de-fb2b-4781-8b6f-739ca41be40f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.885871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.886643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.887020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.887301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.888041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:54.888347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.890176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060b5a-eb50-432e-b08b-c900813a1e4d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.908511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 277/559] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:54.910093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.911220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280078de-fb2b-4781-8b6f-739ca41be40f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.912194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.912474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.920498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.921739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.922356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.922892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.935362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:54.936111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.936604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:54.938993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.945876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 278/560] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:54.946741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.971292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:54.973769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accede39-5b26-4878-9516-a350e71a4f22 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.975734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 283/561] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:54.976806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:54.978795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.979583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.979861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.980204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:54.987840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:54.988777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9baafb9-a0ec-4f1d-ada2-ebd362dfe737 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:54.989983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:54.994224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:54.995223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:54.995696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:54.996481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.005118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:55.006257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 279/562] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.008247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:55.012149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.015815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:55.017200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 284/563] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.018478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.023098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319383-b53f-404b-9964-55aab10b1f6b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.027595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.028255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.028611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.028894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.029695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.030041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.031456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a88490-ab08-403d-bb91-b85e4ea16241 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.031682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.037919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.038838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.039314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.039776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.041261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.041766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.044567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.045525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 280/564] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.046453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.056902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e15184-51f2-4b0e-841b-8939d60b466a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.059053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 285/565] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.060073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.071711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.072375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.072668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.072924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.073685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.073989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.075595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.077906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca85c-75aa-403d-9088-4da0be946b09 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.083404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.084476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.084971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 281/566] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.085282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.085709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.086255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.094279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.095013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c1b28-596d-4279-9b98-ca6284a05fdf admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.097271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.099745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.100890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.101024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.101333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6b2623b20f16432d986a95fc400d52b6/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.114203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:55.115749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 286/567] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.116977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.122183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=6b2623b20f16432d986a95fc400d52b6, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.124933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.127662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297f37d-77c0-4fed-afb5-f9b2ab3fa06a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.132797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.133586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.133870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.134170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.141253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 282/568] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:55 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6b2623b20f16432d986a95fc400d52b6/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:55.142971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.155482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.160981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.195597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-24e30125-4bd5-434b-a752-08606453be38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:55.198031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 287/569] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.199641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633594-71e3-455a-af7e-456231e83078 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.200148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633594-71e3-455a-af7e-456231e83078 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.200645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633594-71e3-455a-af7e-456231e83078 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.202852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 288/570] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:55.205368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633594-71e3-455a-af7e-456231e83078 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.247421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633eb4d-5ef4-494d-a5ef-0ac0055e5730 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.252660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.254815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.256380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.256874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.257957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.258484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.261170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43885b-742f-48b1-a9dd-93093ce4c5c5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.278123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 283/571] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.285552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.286061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.286630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.288175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633594-71e3-455a-af7e-456231e83078 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.293107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.294111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.294568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.294916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.295878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.296406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.298297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.309361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:55.310949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:55.315443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 289/572] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.319954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 284/573] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:55.321459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.321877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.332634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc8740-df99-44ec-a2ad-832c3049d0ac None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.337695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.338894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.339403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.339873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.340124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ee6e-b44d-49b3-b1db-72e9fe670b3b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.345927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.346925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.347296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.347577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/bb7c470fd2684be89d1821f2abb36406/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.350793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.353102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.364926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=bb7c470fd2684be89d1821f2abb36406, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.367643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.368767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ab52aa6e-46b9-4e90-b193-049074395bdf admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 12:51:55.370176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 285/574] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:55.371289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a213e5-b958-4c20-aaaa-dda2c40d997a None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.371571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a213e5-b958-4c20-aaaa-dda2c40d997a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.371847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a213e5-b958-4c20-aaaa-dda2c40d997a None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.373620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 286/575] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:55.375051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a213e5-b958-4c20-aaaa-dda2c40d997a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.386765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 290/576] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:55 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/bb7c470fd2684be89d1821f2abb36406/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:55.387965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.392046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a213e5-b958-4c20-aaaa-dda2c40d997a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.455434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476198d-2faf-478e-8b0a-380324fb9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.456679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476198d-2faf-478e-8b0a-380324fb9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.457061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476198d-2faf-478e-8b0a-380324fb9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.457438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476198d-2faf-478e-8b0a-380324fb9b32 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.474296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476198d-2faf-478e-8b0a-380324fb9b32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:55.476037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc4eb7-3723-4016-9f84-da84bb9454f9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.480938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.481770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.482232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.482629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.483601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.484014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.484598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b476198d-2faf-478e-8b0a-380324fb9b32 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:55.486244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 287/577] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.486639 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.487963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.488420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.489146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.507879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 291/578] 10.222.0.57 () {56 vars in 1158 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.508957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.513765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:55.515533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:55.520256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11d4b5-5976-4f07-80db-0e402e518bff admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.525399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.526564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.526727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 288/579] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:55.531799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.531799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.531799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.531799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.531799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.534475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.545596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400e22f-8ca1-4234-8e1e-bc5fbc9a5fd8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.549794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 292/580] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.551253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.552295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.552794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.553266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.555423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.566863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.569712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.573952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77ca5e-503f-4192-ac37-ea4a4e4cb464 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.579047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.580332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.580449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.580743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.592358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.593471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:55.594554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.596200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 289/581] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.597321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.609130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2fe40-a2b8-489e-a576-06aa0c26e36c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.614864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.615908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.616389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.616859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.620035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:55.621247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 293/582] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:55.622103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.630246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:55.632796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840e35c-f586-48e4-a2de-5518cf2831e0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.637437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.638074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.638387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.638663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.639398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.639705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.639946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:55.641327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.641685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 290/583] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.642728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.652748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410e245-b002-46b8-ba07-013e77021458 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.659673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 294/584] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.661038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.662159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.662920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.663319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.663686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.664524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.664926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.666659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.672642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a691-6700-48e3-bcee-cb2844262877 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.678075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.678926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.679415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.679855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.680893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.681019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 291/585] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.681450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.682022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.683557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.692086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92148df-474f-44b7-878c-6f9b4a05d0d0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.693982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 295/586] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.695049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.697074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.697920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.698293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.698640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.706786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.707120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f81b7-b42c-4bd0-9466-a20251eaa15c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.708990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.712397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.713412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.713868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.714378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.722514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.722796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:55.724036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 292/587] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.724870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.725561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.735336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996f2ab-2588-41fd-96e6-c011a92dd54a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.741037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 12:51:55.742362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.742738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 296/588] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.743275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.743624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.743963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.744372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.756460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.757872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3f408-497a-4cfa-b7ef-e6e635ff26f4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.758953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.765213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.766598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.767384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.768642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.770280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.771072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.774461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.777671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:55.779346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 293/589] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.780175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.789823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684be2-70f4-46be-9289-e1f4edc11d37 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.790540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 297/590] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.791547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.794657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.795301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.795584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.795849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.796698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.797003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.799414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.804053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84453c0-03d0-499e-b4ed-fcb375f10fec admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.811171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.813338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.813811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.814555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.816276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:55.817168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.820236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.832984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 294/591] 10.222.0.57 () {56 vars in 1156 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.834261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.835605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 298/592] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:55.840850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.849067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a658b5-b881-4da9-9466-303106a7429e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.855175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.856312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.856419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebf75-432d-438d-8466-0c06e1fae33e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.856855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.857349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/77e852bb87284a4c9bd820d088bcb759/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.862338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.863040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.863412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.863762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.873245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.874635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=77e852bb87284a4c9bd820d088bcb759, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.875199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.877967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.885011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 299/593] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:51:55.885690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.895663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cac528-5fdd-40b4-8bd5-27d619051426 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.897288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 295/594] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:55 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/77e852bb87284a4c9bd820d088bcb759/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:55.898412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.956414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.957301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.957647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.957988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.965937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.968238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:55.976919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303142fa-410c-403b-a694-1a82b8d917c3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:55.981913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:55.982930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:55.983393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:55.983755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 12:51:55.984096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:55.985104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 300/595] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/users/neutron => generated 85 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:55.991705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:55.997073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:55.999547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.002107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05004-c190-40e2-8950-98894cc47f54 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.006877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.007927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.007927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.008118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.009156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:56.009458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.011382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.020654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:56.022673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 296/596] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:56.029242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.031982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 301/597] 10.222.0.57 () {56 vars in 1160 bytes} [Wed Dec 15 12:51:55 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:56.038405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.040708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbfbf4-fcd1-48ce-b0dc-ac05dc8642f1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.046681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.047764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.048297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.049367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.049800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aafdf-5e02-4d87-8a50-a629cbef7ee6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.050651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:56.051161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.053157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.054686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.055555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.055906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.056250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.067351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.069163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 297/598] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:56.069329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.079272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.094917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:56.094917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 302/599] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:56.096183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27aedf-407c-444a-9536-0f8ce4d502f5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.100886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.111966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363af6-3d83-4f23-8a7e-44c22f88ad49 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.115253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.116748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.117726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.118017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.118330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.118581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.119072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.119173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:56.119539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.119879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.121183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.135218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.137558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.139248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 303/600] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:56.146284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.167420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6068b-8e1c-4d28-afde-f39153417153 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.171439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:56.174003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 298/601] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:56.179869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.185715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.186603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.186885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.187215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.192270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996c28-4448-43ef-9ab9-1f0232ea7307 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.197174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.197366 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.198298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.198772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.199230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.200047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.200536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:56.201035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.203289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.217137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 299/602] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:56.223792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.226400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:56.227968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 304/603] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:56.234055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.237618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134541d-aaaf-4eed-b0d6-ab3289ad8403 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.244375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.245047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.245324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.245590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.246467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=9eca15cf4b614f908d1e47baecadf6ed) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:56.246771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.249207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.253024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9dd6a-8819-4df2-b7dc-907e88573689 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.256255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 300/604] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/role_assignments?user.id=9eca15cf4b614f908d1e47baecadf6ed&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:56.259478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.260147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.260593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.260972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.261878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:56.262339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.264393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc6f1b-9da1-4667-a0df-25b409c3abce admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.283961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 305/605] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:56.295275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:56.311776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9838-926a-44a2-bdee-e6e64708643d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:56.326905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549d03-8ade-450c-b1ed-0b06d099f03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:56.328174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549d03-8ade-450c-b1ed-0b06d099f03d admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:56.328676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549d03-8ade-450c-b1ed-0b06d099f03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:56.329148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549d03-8ade-450c-b1ed-0b06d099f03d admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6300d566628547b48cbe60769799c1bf/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:56.349544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549d03-8ade-450c-b1ed-0b06d099f03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=6300d566628547b48cbe60769799c1bf, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:56.352594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549d03-8ade-450c-b1ed-0b06d099f03d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:56.376547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 301/606] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:56 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6300d566628547b48cbe60769799c1bf/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:51:57.883584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69177e24-1376-4c6b-b96f-98d012e0b92b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:57.884201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69177e24-1376-4c6b-b96f-98d012e0b92b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:57.884201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69177e24-1376-4c6b-b96f-98d012e0b92b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:57.886109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 306/607] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:57.892047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:57.892945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:57.893416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:57.919400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:57.920983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:57.992702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 302/608] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:58.035993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69177e24-1376-4c6b-b96f-98d012e0b92b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.053216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69177e24-1376-4c6b-b96f-98d012e0b92b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.059397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.060188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.060466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.060737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.081470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:58.088319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:58.089804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 307/609] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:58.096302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.110915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6a6d6-e4a9-4b7d-a4c3-25becfc11fe8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.119242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.120182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.120652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.121122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.122061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.122592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.124465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.137718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 303/610] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:58.144129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.159065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39047-6a10-4ccb-bbb0-58905c515676 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.166124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.166915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.167255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.167527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.187306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.189823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.211882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:58.213370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 308/611] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:58.219141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.229327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ec264-c59b-4548-be61-b4dbfa11494b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.238704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.239620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.240102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.240567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.241485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.241995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.243779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.259805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 304/612] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:58.265800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.276302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b06676-6e6f-4609-a7f3-81dfcc604846 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.286579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.287620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.288091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.288580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.296422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.299260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.320445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:51:58.322332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 309/613] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:58.328164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.338753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a10a9a-d23f-4dbc-a301-39b0a1020d3f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.346274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.347198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.347673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.348134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.349192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.349705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.351738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.370540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 305/614] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:58.376256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.390625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e68b-a41c-4ce7-94ff-82f995024dd5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.395981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.396842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.397311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.397808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.410685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.412715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.421951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 310/615] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:58.428266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.438163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf971e1-9682-460c-b0d0-73d9c4d9bd48 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.446200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.447224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.447711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.448172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.463175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.465401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.483651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-752b551a-6a8d-4107-81ca-c16f574f83c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:58.485436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 306/616] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:58.491389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.500497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fab0d-1d3e-405a-84de-903978d292de admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.502708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e11e0-11e6-4d36-9b71-fb832da67e68 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.503823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e11e0-11e6-4d36-9b71-fb832da67e68 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.505078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e11e0-11e6-4d36-9b71-fb832da67e68 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.507369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 307/617] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:58.513188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.513477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.513759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.515692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.516337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.516615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.516888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.517686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.517990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.519624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.544593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 311/618] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:58.550901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:58.552114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:58.553809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.568837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d2fd-dc45-4a0d-9e0f-2995b34dd4b9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.578254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 308/619] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:58.581352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.582162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.584300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.584578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.597955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.599887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.612806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.616866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:58.618859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 312/620] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:58.624980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.632195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252de2e-20d1-4647-805f-eaf9023b9572 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.635172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6e9e-d38f-4921-943a-e49210d6ebb4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.643911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.645139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.645421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.646402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.647630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.648395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.648676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.648950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.651520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.651889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.655898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.671608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:58.679594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:58.683746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 313/621] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:58.690873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 309/622] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:58.697651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.699041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.713433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f4fb-0d53-4219-b892-6378d2731c87 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.720597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a5aa4-71f5-4cba-b7c4-7709f81306e2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.724549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.725312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.725599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.725874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.726724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.727030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.728783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.734858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.735526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.735813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.736121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.736979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6b2623b20f16432d986a95fc400d52b6) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.737288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.739301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.742268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 314/623] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:58.744542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.754949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc1f2f-3d26-4301-99c5-ea822dc5fddb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.756658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 310/624] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/role_assignments?user.id=6b2623b20f16432d986a95fc400d52b6&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:58.759944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.760779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.761064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.761342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.773260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.775246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.795121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:58.802461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 315/625] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:58.803897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.832823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca0103-54ae-4a47-bdc7-d6ca6e18e046 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.849484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.850080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.850389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.850663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.851415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.851722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.853316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.868921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 311/626] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:58.874932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.895839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea679-6233-4bf8-b528-bada0e2ddba8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.911262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.912098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.912360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.912628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.927469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.929523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:58.954300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 15 12:51:58.956303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 316/627] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/users/glance => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:58.962521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:58.984957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d0f2e-114e-4199-b5ce-cc14bd8d3ef4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:58.993591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:58.994316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:58.994608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:58.994877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:58.995764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:58.996072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:58.997941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.033245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 312/628] 10.222.0.57 () {56 vars in 1158 bytes} [Wed Dec 15 12:51:58 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.039619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.056251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8931813-cc20-49f3-804d-3dbd237e7d05 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.065932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.066612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.066896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.067173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.075614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.077372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.090049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 317/629] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:59.093691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.104561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadccf00-8004-409a-8f09-5caa678293d8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.109319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.110105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.110416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.110690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.121523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.123449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.140752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0529240b-24d0-463f-b92f-67f189be930d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:59.146273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 313/630] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.149081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.157642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912cc29-5d1c-4043-b644-e583381dc6c8 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.158573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912cc29-5d1c-4043-b644-e583381dc6c8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.158850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912cc29-5d1c-4043-b644-e583381dc6c8 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.159412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b941fd2-f54a-4079-a7c3-dfefdf7c9e62 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.160867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 314/631] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:51:59.165420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.166171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.166474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.166749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.167253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b7fd-138b-4221-852a-2b5f62588d3b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.167538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b7fd-138b-4221-852a-2b5f62588d3b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.167637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.167814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0b7fd-138b-4221-852a-2b5f62588d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.167909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.169488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.186388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 318/632] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.187256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b4b0b7fd-138b-4221-852a-2b5f62588d3b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:59.188447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b4b0b7fd-138b-4221-852a-2b5f62588d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:59.189589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.197711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 315/633] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:59.199008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348639a5-9f2a-4887-b1da-34ed0f65eb79 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.199291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348639a5-9f2a-4887-b1da-34ed0f65eb79 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.199567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348639a5-9f2a-4887-b1da-34ed0f65eb79 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.200420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473aba1-b8db-42a5-8fad-3c44c88822be admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.201202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 316/634] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:59.205936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.206729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.207010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.207284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.209466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.209824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.210182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.216047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.218132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.228398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:59.229609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:59.232476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:59.233818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 319/635] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:51:59.234649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.238364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 317/636] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:51:59.243442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.245048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaabe1c-e81c-4737-989c-47abf211733e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.256298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef98473-e827-460c-8d8f-1d9cfb353474 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.258886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.259657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.259938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.260212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.265163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.266425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.267005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.268161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.269185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.269854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.272258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.273145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:59.280117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:59.281306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 320/637] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.282127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.290329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 318/638] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:59.292153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.293572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea1ddb-d8d7-4dd0-8a7f-2f67fb7d1f47 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.298449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.299341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.299521 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.299773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.305170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f28be5-6212-486b-ae89-ef330440f934 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.310538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.311297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.311837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.312320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.312523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:59.313283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.313688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.315934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.320575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:59.322095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 321/639] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.322895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.328650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 319/640] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.331987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.336612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1337-6a76-4bfb-9462-2b33df29e17a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.341303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.342028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.342437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.342894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.343726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=bb7c470fd2684be89d1821f2abb36406) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.344065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f6fdb-24fb-4832-a8bc-480d76f187a4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.344181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.346113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.349860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.350579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.350849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.351146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.351886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.352193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.353782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.354096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 322/641] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/role_assignments?user.id=bb7c470fd2684be89d1821f2abb36406&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.355118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.366071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 320/642] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:59.372026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.375956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eac89-738a-4b75-a00d-a68f146e353a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.381369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.382296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.382647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.382988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.387454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654250-bb66-4810-ad76-cc58e1f590a1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.395749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.398998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.402794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.403616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.403941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.404212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.422924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.424836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.435892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:59.437345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 323/643] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.447280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.465220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:59.469361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d62dd4-86a2-47bd-b98b-3332b9a26859 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.471949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 321/644] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.475965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.476743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.477023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.477298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.478103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.478443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.480186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.483360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e583356-e0c7-408b-a21c-a8f07aff51a0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.491066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba04afa-3649-4970-8222-bab2f1d56b1b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.496037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.496863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.497214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.497562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.498576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.498683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 324/645] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.498966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.505202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aaf5d-787e-4cfc-904d-9038af13b125 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.505384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7420a-cf1e-416d-844e-c4588e700e33 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.506013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aaf5d-787e-4cfc-904d-9038af13b125 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.506492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aaf5d-787e-4cfc-904d-9038af13b125 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.508564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 325/646] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:51:59 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:51:59.509589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aaf5d-787e-4cfc-904d-9038af13b125 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.515380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 322/647] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.518173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.518173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.518173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.531439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aaf5d-787e-4cfc-904d-9038af13b125 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.537076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.537252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:51:59.538346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.538455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:51:59.538945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.539413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.547552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 323/648] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:51:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:51:59.549269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.550421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.552732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.560960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3da7-33df-49e4-9fde-1a99b6782d1f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.566109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.567003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.567296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.567633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.569794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 12:51:59.571606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 326/649] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/users/cinder => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.576589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.578235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.578964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.589336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83827d-c122-4c56-995d-b8481f054962 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.594368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.595415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.595899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.596388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.597264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 12:51:59.597655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.598199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.598978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 324/650] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.605070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.605268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.621022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09ff5-0d12-402f-92a6-5fc5aa674041 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.629734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.630582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 327/651] 10.222.0.57 () {56 vars in 1158 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:51:59.630721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.630882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.631152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.631538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.643318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:51:59.643887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c4405-adff-4e03-b4b0-8efd68149adb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.648301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.649139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.649421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.649695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.650572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.650880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.651300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:51:59.652728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.652838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 325/652] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.653630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.664151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04cb11-f7f5-4b3b-900f-564c1400f7d5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.671318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.672162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.672444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.672714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.676840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 328/653] 10.222.0.57 () {56 vars in 1156 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.676840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.682757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.684772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.688340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a973-dc70-4003-90c6-7723bbf423fd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.693218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.693860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.694165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.694440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.695214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 326/654] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:51:59.695319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.695598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.696006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.697441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.705430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc2b21-1c1e-4495-bb63-6b6d26813fa6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.706655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 329/655] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.707514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.711887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.712650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.712923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.713264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.717251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c7beb-2485-4ddc-812d-42c60794aa79 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.721832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.722633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.722915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.723189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.725035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.727002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.733580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.736549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.746603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:59.747950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 327/656] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.750321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.755527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:59.756963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 330/657] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.757738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.760380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b763a-5699-4c91-b9b8-8320288fbd98 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.765292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.766049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.766373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.766633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.776023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438aa6e-0208-4b40-9991-285b9499e219 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.778864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.780684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.783019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.784028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.784311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.784583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.785626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.785929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.787694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.800692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:51:59.801325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 331/658] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.801950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.802254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 328/659] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.815143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.824554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fbc1f-1da4-4c29-b4e0-386349e0c074 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.828834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.829464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c418-0872-4a1d-8321-64b63c8e7485 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.830115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.830486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.830833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.831636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.832017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.833595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.837359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.838352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.838926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.839424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.840485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.841594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.844199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.850990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 332/660] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.851796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.858685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 329/661] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.860084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.861948 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e44617-06d8-43ad-bb9b-cd8cd8af93a7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.866889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.867671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.867992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.868319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.872945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae0f84-9628-4db7-b07f-4b5c9a9f34e1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.875916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.878042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.878586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.879654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.880272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.881042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.888572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.890721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.892726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:59.898237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 333/662] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.898237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.910879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aa884-36e2-4421-befb-22abaa1cab66 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.912313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:51:59.914086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 330/663] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.919298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.923534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.924626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.925174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.925675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.928279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39815a-755a-4440-a833-3247c3a2c815 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.933512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.934500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.934803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.935082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.935688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.935903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.936213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.938118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.938696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.953887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 15 12:51:59.955766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 334/665] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:51:59.956867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.957486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 331/665] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.958495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.967797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bb244-9277-43cf-8289-20b49ff3bcfb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.968990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab97e0-4263-4b1c-bd32-72cb51e1da1b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:51:59.974086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.974518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:51:59.975284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.975412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:51:59.975672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.975947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/9eca15cf4b614f908d1e47baecadf6ed/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.976333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:51:59.976873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:51:59.978124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:51:59.978688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.980832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:51:59.993171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=9eca15cf4b614f908d1e47baecadf6ed, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:51:59.994353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 335/666] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:51:59.995458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:51:59.996180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.013386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9baa79d-c25e-4ef3-a5e5-0441af406a51 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.019241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 332/667] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:51:59 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/9eca15cf4b614f908d1e47baecadf6ed/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:52:00.020228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.123654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.124646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.125102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.125550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.127253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:00.129160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.132691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.151359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33790acd-3e9b-4570-b8ef-b2a8ab80dbb2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.163049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 336/668] 10.222.0.57 () {56 vars in 1160 bytes} [Wed Dec 15 12:51:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:00.164049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.165009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.165534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.166002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.167137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=77e852bb87284a4c9bd820d088bcb759) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:00.167644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.168723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.171808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.185549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 333/669] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/role_assignments?user.id=77e852bb87284a4c9bd820d088bcb759&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:00.188571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021ef1f-0a72-4fd8-b062-8d8e068d01ef admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.194204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.195433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.195919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.196694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.207288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.209505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.221155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 337/670] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:52:00.231401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.248076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aca6ef-38f1-4a8c-8c14-741ce1434823 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.257202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.258614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.259119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.259603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.273418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.275793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.301486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:00.303497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 334/671] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:00.309244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.319161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5d020-e71f-4a5f-a581-2750cf3c0c6c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.327849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.328707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.329072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.329444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.330845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:00.331248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.332962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.347099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 338/672] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:00.352816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.366081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae415e-3cea-4fc4-8249-9dd1ea2b0dbc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.372589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.373396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.373726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.373934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.385274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.387317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.406750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:00.408085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 335/673] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:00.415063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.426047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2722e-6b09-49e7-a0fd-6b7f69eee5fc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.430919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.431728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.432113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.432486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.433415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:00.433851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.435868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430fd8c-d635-4608-b5d8-3433a1ac5f6f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.449602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 339/674] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:00.456625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:00.467152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96504cc2-501f-4c4d-acde-d9254b931aaf admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:00.471921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:00.472674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:00.473061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:00.473426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:00.474446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6300d566628547b48cbe60769799c1bf) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:00.474845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:00.476856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ed03-ad38-41c0-8644-adbfc0167cd2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:00.483533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 336/675] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:00 2021] GET /identity/v3/role_assignments?user.id=6300d566628547b48cbe60769799c1bf&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:02.075257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0fb27-afb8-4d41-ab9b-e30c5bc7868c None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.075773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0fb27-afb8-4d41-ab9b-e30c5bc7868c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.076348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0fb27-afb8-4d41-ab9b-e30c5bc7868c None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.078505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 340/676] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:02.085044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.085456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.085771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.108641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:02.109973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:02.121378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 337/677] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:52:02.151447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0fb27-afb8-4d41-ab9b-e30c5bc7868c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.171945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0fb27-afb8-4d41-ab9b-e30c5bc7868c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.176658 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.177758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.178137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.178529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.201025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:02.208815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:02.214547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 341/678] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:02.218584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.236989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0189ccc-92b0-4b78-bbe6-c38703691417 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.243226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.244011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.244428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.244802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.245673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.246075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.248673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.263588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 338/679] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:02.271147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.283875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bdc39-5c64-465c-a064-e2750905aa61 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.294311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.295216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.295595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.295970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.308743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.310712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.335589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-670a66e6-b6bc-4680-b366-6467c94d0ae6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:02.337126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 342/680] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:02.343308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.350994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd2bb-4f97-43d4-91f2-0fea765f2c2f None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.352386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd2bb-4f97-43d4-91f2-0fea765f2c2f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.352938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd2bb-4f97-43d4-91f2-0fea765f2c2f None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.355108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff40b8a-4e15-451a-bf17-94ea6f5ee0a1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.358502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 343/681] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:02 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:02.363874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.364749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.365554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.368661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.369437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.369816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.370233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.371079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.372181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.374941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.391941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:02.393323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:02.398551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 339/682] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:02.404453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.413116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 344/683] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:52:02.421619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7031a5d-6556-4598-916e-abe092528dea admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.432692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.433484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.433761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.434056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.445277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.447354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.449400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.454842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36f5f1-5dad-4454-b801-0cb6797103ff None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.460455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.461435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.461716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.461986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.474777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:52:02.475803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 340/684] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:02.483929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.485679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.487589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.497940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a58ad-0b97-4e06-b11f-280dd35fb6ee admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.519367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.520030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.520670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.520937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.521791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.522093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.523578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:02.523941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.525156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 345/685] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:02.531749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.554622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae7ad6-4038-41dc-9576-789d2a31e40c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.558806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 341/686] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:02.565535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.568151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.568848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.569131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.569409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.570230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.570543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.572294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.583906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88511-66a2-4aaf-96ec-a39569b8c14f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.590353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 346/687] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:02.593752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.594449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.594759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.595060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.598382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.612772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.614740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.618241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca734-07ab-465c-98d1-61bdd3c79408 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.631665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 342/688] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:52:02.634066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.634922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.635305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.635683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.636529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.637787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.638768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.647467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c2a8-d499-47f0-96c9-c8e55175c29b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.653970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.655194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.655480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.655747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.670450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.672544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.676896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 347/689] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:52:02 2021] POST /identity/v3/users => generated 254 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:02.693244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:02.694983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 343/690] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:02.701206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.715597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d193c-b7f3-4b00-861f-43982486c576 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.725337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.726813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.727302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.727885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.729881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.730536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.732433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.756966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 348/691] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:02.763354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.775878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812310b-870b-4bb4-ad34-d111748f9445 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.784071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.785391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.785851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.786295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.796155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.798689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.815916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:02.817153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 344/692] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:02.823826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.845255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50d9a-7e8c-4cc3-9a13-4c3d99d0547c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.859094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.860073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.860503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.861455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.862562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.863027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.865969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d9f0-e4c8-416e-bad3-2b37fc354775 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.889863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 349/693] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:02.896431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:02.913484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97732-89f0-4369-af56-d23c30775f2d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:02.922620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:02.923849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:02.924146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:02.924421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:02.925286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6b2623b20f16432d986a95fc400d52b6) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:02.925595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:02.927507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ae3af-730b-43a7-8b83-84fdd5c87b71 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:02.934198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 345/694] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:02 2021] GET /identity/v3/role_assignments?user.id=6b2623b20f16432d986a95fc400d52b6&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.100052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fac9-0897-48ab-b09a-c6aca7253d15 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.100828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fac9-0897-48ab-b09a-c6aca7253d15 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.100828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884fac9-0897-48ab-b09a-c6aca7253d15 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.102807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 350/695] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:03.109206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.109692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.109765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.135090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:03.136306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:03.146784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 346/696] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:52:03.172122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fac9-0897-48ab-b09a-c6aca7253d15 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.189963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884fac9-0897-48ab-b09a-c6aca7253d15 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.198477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.199627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.200095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.200502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.201397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.203352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:03.203352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:52:03.203352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:52:03.204712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.222228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e2942bec-1d63-4e79-a815-54f69eb6ce35 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 12:52:03.224123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 351/697] 10.222.0.57 () {56 vars in 1150 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:03.231080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.250403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d98cb9-8339-489c-b029-ffd7392cb0c5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.256626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.257157 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980835-d78f-49b7-b542-a4827d892edd None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.257339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.257455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980835-d78f-49b7-b542-a4827d892edd None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.257647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.257742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c980835-d78f-49b7-b542-a4827d892edd None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.257914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.258591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.258890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.259842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 352/698] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:03.259947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:03.259947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:52:03.259947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:52:03.260766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.266918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.267236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.267505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.267725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 347/699] 10.222.0.57 () {56 vars in 1145 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.276104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.291539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d1e0f-a5fd-4ede-a924-6c19ee59afee admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.292388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:03.293799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:03.297589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.298832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.299124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.299411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.300252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.300561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.302187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.310535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 353/700] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:52:03.314208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 348/701] 10.222.0.57 () {56 vars in 1145 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.329993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.339627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213b1ee-893e-4e7c-9563-08322dbd3a4a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.344365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.345475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.345927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.346368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.358275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:03.365857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:52:03.372765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 354/702] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:03.374463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.384800 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2280-c343-4faa-acbc-896fae030608 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.389634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.390572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.391018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.391432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.392874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.393319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.395118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.409626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 349/703] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.411542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.425453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428eb62-9ef5-4fe1-b532-a49bc457b3e8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.430183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.431150 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.431586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.431993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.448336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.450446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.474027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:03.480921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 355/704] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:03.482586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.493204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60acb1-eae8-4749-8ed4-9a4d1f283886 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.498004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.498906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.499355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.499770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.500655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.501102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.502958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.521461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 350/705] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.523108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.533306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f0c8-1ca5-47fb-89d4-ac8cca99ae66 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.538340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.539341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.539788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.540204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.549465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.551688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.565571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 12:52:03.572283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 356/706] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:03.573964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.584867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1924a-393e-4551-bfc6-4ddb0fb21a46 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.589811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.590759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.591199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.591613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.592611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.593054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.595190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffcff7-7457-4d9e-9e74-bc81fb0be142 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.622096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 351/707] 10.222.0.57 () {56 vars in 1156 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.623711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.634552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85c8a8-697a-4187-bec0-63041bea3d5e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.639492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.640462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.640895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51df51-a665-4b87-8d20-4825da70dfb9 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.641038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.641324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51df51-a665-4b87-8d20-4825da70dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.641583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.641734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51df51-a665-4b87-8d20-4825da70dfb9 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.645203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 352/708] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:03.651312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.653458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.653804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.654091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.654453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.670349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 357/709] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:52:03.672144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.683679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6f022-4a6e-4b46-a2e4-a6c5e7acaa77 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.689073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.690064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.690398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:03.690659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.691067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.691902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:03.708540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.709025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 353/710] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:52:03.710598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.730871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:03.732625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 358/711] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:03.739874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.740493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.749798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb8027-0147-4e57-b916-6e44c80edebf None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.751089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46559b1b-694c-42bb-bf4d-7a36b1ae3b78 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.755760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.756064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.756517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.756796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.757063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.757296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.757729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.757941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.758374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.759866 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.759977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.760566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.762392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.770842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 12:52:03.772419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 359/712] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:03.781730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 354/713] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.783718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.784066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.794677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee159de-bb9a-413b-be35-4540d32e960a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.800014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.800552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9410-e6d3-4c8c-8e54-85fcacd2424c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.801008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.801357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.801697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.809686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.810531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.810970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.811380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.812352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.812948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.814761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.824454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 355/714] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.825745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.832418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.834564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.844600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e36ed-b55b-4927-ad40-044e301ad03a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.855495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:03.857209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 360/715] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:03.863052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.863372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.863722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.864010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.864287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.865028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.865335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.866962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.874133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfae72-77d9-4c15-9476-d428c80c267a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.879513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.880176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.880497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 356/716] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/services?type=network => generated 124 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:03.880809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.881130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.881992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.882292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.884241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97bf8d-bbcb-424e-aa19-b4c2f5c5542d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.906216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 361/717] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:03.915319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:03.936592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df48a4c-addf-4dad-836f-aa2daac8c9f2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:03.944899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:03.945571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:03.945855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:03.946132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:03.947017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=9eca15cf4b614f908d1e47baecadf6ed) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:03.947328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:03.949237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d207a59-2f21-4750-a553-6f2b53e8ced0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:03.963346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 357/718] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:03 2021] GET /identity/v3/role_assignments?user.id=9eca15cf4b614f908d1e47baecadf6ed&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:05.816858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa4e1-04d4-463b-b36a-9aa8114a6517 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:05.817426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa4e1-04d4-463b-b36a-9aa8114a6517 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:05.817426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aa4e1-04d4-463b-b36a-9aa8114a6517 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:05.819431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 362/719] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:05.825489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:05.826108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:05.826108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:05.851968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:05.853210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:05.866608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 358/720] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:52:05.910063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa4e1-04d4-463b-b36a-9aa8114a6517 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:05.925599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aa4e1-04d4-463b-b36a-9aa8114a6517 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:05.931697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf4bd4-f543-4894-b90a-4fdbd2653c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:05.932477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4bd4-f543-4894-b90a-4fdbd2653c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:05.932749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4bd4-f543-4894-b90a-4fdbd2653c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:05.933016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf4bd4-f543-4894-b90a-4fdbd2653c96 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:05.946966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf4bd4-f543-4894-b90a-4fdbd2653c96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:05.953698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-f7cf4bd4-f543-4894-b90a-4fdbd2653c96 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:52:05.955258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 363/721] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:52:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:05.961004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:05.975337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baf086-c11d-4e21-ad72-5b7cb75810c4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:05.985997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:05.986703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:05.986988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:05.987265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:05.988037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:05.988209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a41604-75ad-450a-9366-13d2311d8cac None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:05.988449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:05.988615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a41604-75ad-450a-9366-13d2311d8cac None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:05.988761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a41604-75ad-450a-9366-13d2311d8cac None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:05.990002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:05.990472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 364/722] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:52:05.997176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:05.997445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:05.997708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.005374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 359/723] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:52:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.015342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.033146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfba9-efb6-4d39-b0c3-30da631aa496 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.035029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:06.037277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:06.042083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.042926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.043210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.043483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.054051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 365/724] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 15 12:52:06.058502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.060558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.078856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:06.081975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 360/725] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.087781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.093989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.104452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ab06-12b6-436e-8542-09d251ac018c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.104848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae11cb5-c99a-4cc5-b130-b89e7a2b4bd4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.115415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.116191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.116464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.116734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.118247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.118893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.119165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.119430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.120160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.120458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.124384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.147163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 366/726] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.147499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:06.154394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.156388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:06.158288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 361/727] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:06.171226 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb999-ec83-4189-bc92-e24ea2b9b083 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.174375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.185858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.186732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.187045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.187341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.192514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da9c4b-ee4e-4cee-91c3-e8765b5a478a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.203038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.203774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.204056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.204406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.205873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.207968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.209034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.209392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.210987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.232515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 362/728] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:06.233098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 12:52:06.238326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 367/729] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.240561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.247355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.252393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4cee1-e809-4ee6-a907-a245d9663580 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.264627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b8c15-4d5e-476a-9c9b-03919568a815 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.265594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.266465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.267824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.268113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.274829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.275479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.275754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.278079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.281141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.281324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.284987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.288718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.290585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.317907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 368/730] 10.222.0.57 () {56 vars in 1170 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.319008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:06.320510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 363/731] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:06.323398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.325818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.339514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27ee7f-eaff-4233-88bf-024bdfa53e71 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.341626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455393-1c2f-4807-82c7-cc45e1773674 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.344233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362ea4a-05ce-4ed4-b363-fe307391f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.345097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362ea4a-05ce-4ed4-b363-fe307391f6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.345489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362ea4a-05ce-4ed4-b363-fe307391f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.345794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362ea4a-05ce-4ed4-b363-fe307391f6c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.346301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.346948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.347221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.347490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.348217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.348512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.350097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.353919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362ea4a-05ce-4ed4-b363-fe307391f6c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.355687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362ea4a-05ce-4ed4-b363-fe307391f6c1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.365873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 369/733] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 12:52:06.367310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bace4-89a9-4847-8d83-10b65a9e3743 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.367598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bace4-89a9-4847-8d83-10b65a9e3743 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.367873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bace4-89a9-4847-8d83-10b65a9e3743 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.369496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 364/733] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.369720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 370/734] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:06.370425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.371491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bace4-89a9-4847-8d83-10b65a9e3743 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.385606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e653-f834-4cc1-8c08-285dc9c78aba admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.390801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bace4-89a9-4847-8d83-10b65a9e3743 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.392589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.394533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.394924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.395289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.397251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.398108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.398913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.398913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.405664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.409169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.410991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.412934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.426178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-91526118-d3fe-47ed-9c1f-ae300026cc37 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:52:06.427665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 365/735] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.428872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.429146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.429415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.433247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:06.434861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 371/736] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.440550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.456910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:06.458472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d3a7-95a2-479f-9ede-7b13f4850550 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.458705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:06.466948 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.468169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.468643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.468750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 366/737] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 15 12:52:06.469819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.474565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.477701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.478260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.483615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.488968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea77d8-8c72-4a3c-9c0d-134b701d6979 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.498414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.499548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.500029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.500615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.501633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.502307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.503961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.521752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 367/738] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.521752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.527089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 372/739] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.527786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29591ee9-28f4-4fe1-8ef6-f59031736558 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.528436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.533076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.533768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.534047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.534344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.535392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.536392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:06.536392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:52:06.536392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:52:06.537776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.542030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e72456-2a98-4724-a08c-dd9b0341ac25 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.552415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.553763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.554516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.554991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.561598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 368/740] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:06 2021] POST /identity/v3/services => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:06.562783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.572556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.574583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.598755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:06.601139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3e5f-bf22-46f6-bc39-3fffd8eeb341 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.606470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 373/741] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.610898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.612509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.619183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.619934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.620409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.636478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9594-d7f8-49da-b9b4-d9d2505b1506 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.636980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.639576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.654991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.655678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.655949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.656243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.657043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.657371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.659341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.664345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:06.666030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 369/742] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.675304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.686182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 374/743] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:06.691978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37600d-6893-4971-b7c6-33c4acb8c06b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.694832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.706202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd1b63-a460-48ff-8c95-d0ec09866f87 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.708765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.709447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.709754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.710023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.711291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.711594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.714677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.719107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.720356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.720712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.720922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.721840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=eb5d649917c74d81b0c2fad7c2ba1028) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.723942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.727447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.739389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 375/744] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/role_assignments?user.id=eb5d649917c74d81b0c2fad7c2ba1028&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:06.741306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 370/745] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.751928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.764874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d3009-da9a-4b6a-a96b-aceec5169333 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.769692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.770535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.770878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.771148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.779015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.781047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.797059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:06.799191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 376/746] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:06.822853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.834548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8221a6-7326-4a30-8aaa-ac730c6d4713 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.843090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.843791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.844074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.844351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.845829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:06.846161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.849904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7810ab5-dbad-40b9-95f8-bcc36d90e096 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.865932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 371/747] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:06.873594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:06.888420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84c6d6-ecff-4f11-b6b8-6740d00728b2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:06.893106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83441901-86fc-457f-9a96-180e0391b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:06.894001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83441901-86fc-457f-9a96-180e0391b2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:06.894325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83441901-86fc-457f-9a96-180e0391b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:06.894597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83441901-86fc-457f-9a96-180e0391b2ef admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6b2623b20f16432d986a95fc400d52b6/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:06.896921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83441901-86fc-457f-9a96-180e0391b2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=6b2623b20f16432d986a95fc400d52b6, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:06.899739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83441901-86fc-457f-9a96-180e0391b2ef admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:06.920916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 377/748] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:06 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6b2623b20f16432d986a95fc400d52b6/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:52:07.011323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa2ab-c4dc-4f25-be69-15a8becdb618 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.011770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa2ab-c4dc-4f25-be69-15a8becdb618 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.012149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa2ab-c4dc-4f25-be69-15a8becdb618 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.014419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 372/749] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:07.021218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf10bdf-7d6f-417c-8855-410d89f11b41 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.021539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf10bdf-7d6f-417c-8855-410d89f11b41 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.021768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf10bdf-7d6f-417c-8855-410d89f11b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.044919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-daf10bdf-7d6f-417c-8855-410d89f11b41 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:07.046179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-daf10bdf-7d6f-417c-8855-410d89f11b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:07.113839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 378/750] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:07 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:07.137634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa2ab-c4dc-4f25-be69-15a8becdb618 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.151307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa2ab-c4dc-4f25-be69-15a8becdb618 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.157327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e15f8-edf0-487a-91d2-35fd59457db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.158077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e15f8-edf0-487a-91d2-35fd59457db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.158388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e15f8-edf0-487a-91d2-35fd59457db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.158706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e15f8-edf0-487a-91d2-35fd59457db0 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.159459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e15f8-edf0-487a-91d2-35fd59457db0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.161420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e15f8-edf0-487a-91d2-35fd59457db0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.178699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 373/751] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:07 2021] POST /identity/v3/services => generated 240 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:07.315762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273a1c-a523-42f2-af6d-c3a1e91485df None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.316103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273a1c-a523-42f2-af6d-c3a1e91485df None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.316306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273a1c-a523-42f2-af6d-c3a1e91485df None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.318248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 379/752] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:07.324528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.324817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.325096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.344149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:07.345440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:07.362745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 374/753] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:07 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:07.387129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273a1c-a523-42f2-af6d-c3a1e91485df None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.400305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273a1c-a523-42f2-af6d-c3a1e91485df None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.406006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.406820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.407092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.407434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.419244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:07.426425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:07.427993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 380/754] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:07.434514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.444198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140791f5-bad7-4014-89d8-1c65bfa215bf None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.448782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.449442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.449719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.449987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.450787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:07.451087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.452732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.469244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 375/755] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:07.475887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.486267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ad318-4d71-4fef-99a6-0820182eee3c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.490740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.491508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.491781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.492050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.503146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.505029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.520953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:07.522440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 381/756] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:07.528610 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.539502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adfb51-e229-471b-b4b7-6b93a94dccd6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.544752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.545394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.545720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.545992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.546754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:07.547052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.548809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.562225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 376/757] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:07.568711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.579251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd7c67-3ec1-40e1-b7ec-7f90fb153448 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.583875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.584640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.584965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.585234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.593188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.595754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.609319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 12:52:07.610828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 382/758] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:07.616995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.627348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2ee5e-b4e6-40c9-8d76-5f2022dbabd6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.631886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.632586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.632861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.633130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.634063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:07.634395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.636257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.654126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 377/759] 10.222.0.57 () {56 vars in 1156 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:07.660976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.670671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f9fee-d131-4d04-a703-3438cd4968b4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.675144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.675815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.676093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.676361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.692188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.693984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.707499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 383/760] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:07.713577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.727030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58f46f-e3b6-4c79-8925-aba2d7d941bb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.732128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.733000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.733280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.733545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.746751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.748649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.769916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:07.771325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 378/761] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:07.777509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.787535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72340c7-9c5d-4a69-a323-1d5f33162950 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.792218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.792868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.793151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.793423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.794173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:07.794475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.796148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.817634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 384/762] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:07.823701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.834740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c682bc2-2135-48b6-b57e-f9320fdad3aa admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.842065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.842933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.843216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.843487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.854474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.856503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.884722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:07.886254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 379/763] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:07.892556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.903129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7743a7-fc9d-4fd7-858d-9ddad39c0847 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.907678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.908268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.908544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.908814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.909667 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:07.909971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.912120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5669b1e-ad75-4864-97ab-d34e58deb198 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.924926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 385/764] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:07.931410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:07.943448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40f72-0ea3-4868-9f33-2c39940ed837 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:07.948533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:07.949421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:07.949926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:07.950443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:07.951641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=9eca15cf4b614f908d1e47baecadf6ed) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:07.952182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:07.954287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab053a-9ef2-4b87-a256-9349d340a27d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:07.966173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 380/765] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:07 2021] GET /identity/v3/role_assignments?user.id=9eca15cf4b614f908d1e47baecadf6ed&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:09.723872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5762-c4f4-47e3-87d3-06577039c7cb None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.724439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5762-c4f4-47e3-87d3-06577039c7cb None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.724439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5762-c4f4-47e3-87d3-06577039c7cb None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.726445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 386/766] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:09.732613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.733463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.733952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.759119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:09.760692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:09.769121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 381/767] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:09 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:09.793256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5762-c4f4-47e3-87d3-06577039c7cb None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:09.809417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5762-c4f4-47e3-87d3-06577039c7cb None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:09.818778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c37ff-7580-4896-bd2d-b868d7c3d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:09.819577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c37ff-7580-4896-bd2d-b868d7c3d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.819859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c37ff-7580-4896-bd2d-b868d7c3d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.820129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c37ff-7580-4896-bd2d-b868d7c3d7d5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.832130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c37ff-7580-4896-bd2d-b868d7c3d7d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:09.838930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-228c37ff-7580-4896-bd2d-b868d7c3d7d5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:09.840489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 387/768] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:09.846548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:09.855688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0339fd-9c36-44cd-8bfb-1d33fd8f816c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:09.857696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5143b-8b21-4e7d-8628-b5ef586d963a None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.857985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5143b-8b21-4e7d-8628-b5ef586d963a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.858304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5143b-8b21-4e7d-8628-b5ef586d963a None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.860418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 388/769] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:09.860878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:09.861512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566385fa-4e2b-4e5d-aeee-b55beb8ffa78 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.861737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.861850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566385fa-4e2b-4e5d-aeee-b55beb8ffa78 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.862041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566385fa-4e2b-4e5d-aeee-b55beb8ffa78 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.862305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.862683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.863548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:09.863856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 389/770] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:09.864053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:09.865844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7cc96-8d02-45b4-9650-bf9581509e08 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:09.869066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.869352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.869631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.875307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 382/771] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:09.877405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.878627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.879020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.890748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:09.892572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:09.901178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 390/772] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:09 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:09.902060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:09.903646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:09.904836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:09.918518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 383/773] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:09 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:09.921841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f0da7-b35e-4ee8-9fec-73f60424ec22 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:09.927599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:09.928651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.929151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.929620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.931091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:09.942074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeae39-11d7-4b54-b9d6-b8d6757cf7dc None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:09.947649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:09.949753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:09.951364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:09.953188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.953758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.954386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.967611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:09.968456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:09.970548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 391/774] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:09.971344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:09.976915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:52:09.979412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 384/775] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:52:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:09.980433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:09.980934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35f32-8eb5-4467-ab08-479d55d3f0a0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:09.990598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:09.991427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.991707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.991953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43d69-0f6c-4b2f-ac75-068c19aa11c3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:09.992065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:09.992630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:09.994328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:09.997792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:09.998913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:09.999390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:09.999861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.000783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.001793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.003580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.006696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 12:52:10.007910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 392/776] 10.222.0.57 () {56 vars in 1150 bytes} [Wed Dec 15 12:52:09 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.008770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.017961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a186fe-c94d-49ec-b54a-7b3bce86feaf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.019148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 385/777] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.023162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.023162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.023390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.023696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.024668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.024781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.025083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.026868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.036966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769ef5d-44cd-470e-8588-6f6e0514452b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.038511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 393/778] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.042470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.048269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.048995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.049341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.049682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.050522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.050890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.052642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.056282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b528b-a1f9-41bb-8482-97caa5dfcd4b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.062167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 386/779] 10.222.0.57 () {56 vars in 1145 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.062167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.070170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.071232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.071733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.071904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7537-c80c-4fba-a86a-d0f85664d0fd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.072372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.076447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.077161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.077437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.077706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.083047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.085718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.088324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.090125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.102750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:52:10.104162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 394/780] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.105128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.110192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:10.110192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 387/781] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.114644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.119926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c17ab-c86f-4f88-ac9f-2b6773400314 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.124249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96175ab-9d14-48be-8e36-fe29f520c82e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.124762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.125610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.126188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.126632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.127526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.128010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.128796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.129382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:10.129382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:52:10.129382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:52:10.129605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.129699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.129942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.130817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.131118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.131284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.132941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.139547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 395/782] 10.222.0.57 () {56 vars in 1145 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.140625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.150617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568031f-22e5-46b8-8604-46f51af0df44 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.158178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 388/783] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:10.158178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.161194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.162049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.162529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.162974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.163891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.164365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.164859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac175c-2549-4008-90d5-ae3593fdafbc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.166372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.170204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.170913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.171277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.171613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.172472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] RBAC: Adding query filter params (interface=public, service_id=09271f8b537547bebc43002c2f621f8e, region_id=RegionOne) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.173392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.174657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:10.174657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:52:10.174657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:52:10.176105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.181063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 396/784] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.182196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.191402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 389/785] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/endpoints?service_id=09271f8b537547bebc43002c2f621f8e&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.192660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.197845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0588a-260f-4fcf-a8fd-f068a8c13544 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.202638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.203526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.203957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b589c-3b1e-4428-9475-8d8f53b06317 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.204747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.205206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.209163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.209938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.210294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.210611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.214334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.216327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.219262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.221475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.226081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 397/786] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:10.227225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.236817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc951d-05bd-4db1-8438-b1986f872cfe admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.237910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 12:52:10.239672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 390/787] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.245217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.247443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.248311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.248833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.249296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.250267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.252255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.255976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8277e-4d1b-4bf4-b493-c781dfdcaa55 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.258437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 398/788] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.259710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.260521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.261407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.261685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.261953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.271370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28854-7f97-49cc-86e0-219cd2881fc8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.276156 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.276681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.277610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.277986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.278352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.278864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.279901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.280430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.282727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.300752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:10.302863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 391/789] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.306203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 399/790] 10.222.0.57 () {56 vars in 1170 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.310116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.311967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.322323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41dee-c25f-44b6-9e25-81ad499b2cdb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.326729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184548-9e6c-4245-a585-2524dd5c21c2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.333100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.333779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.334055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.334353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.335101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.335398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.336975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.340919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.341721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.341992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.342291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.363868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 392/791] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.364769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.366656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.369682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.388783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9cacd-6e71-4025-bd5c-5fc074358d46 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.397331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:10.403661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 400/792] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:10.404964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.409683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.410784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.411071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.411532 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.415296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf239fc-38e0-4408-b1b6-a1a4224049fd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.427337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.428287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.429010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.429284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.429551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.430376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.430678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.433880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082c13e-daac-4d28-b71d-8dfc5bfc88f3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.434916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.457136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:10.457597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 401/793] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.458457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 393/794] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.459212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7f4a-6f0e-40bb-a5c5-27bae0511e1e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.459565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7f4a-6f0e-40bb-a5c5-27bae0511e1e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.459844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de7f4a-6f0e-40bb-a5c5-27bae0511e1e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.461818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 402/795] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:10.463064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.465934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7f4a-6f0e-40bb-a5c5-27bae0511e1e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.477092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c8056-b095-4b33-a2ed-b39c43aecf3f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.482857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.483161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de7f4a-6f0e-40bb-a5c5-27bae0511e1e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.483583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.483857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.484130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.488610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.489337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.489629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.489903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.490836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.491144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.492939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.493156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d096dd-cba7-4268-b389-8b48ab1205c9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.495250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.511411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:10.514351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 403/797] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.515860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.516146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.516421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.517700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 394/797] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:10.519270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.533169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a45be-f303-419a-85f2-3717beba61da admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.535571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:10.536754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:10.538098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.538769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.539042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.539330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.540280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.540671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.542541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.545073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 404/798] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:10.545877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.557536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b038c-2783-4283-b3ae-c0deccccb96c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.561605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 395/799] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.563026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.564970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.565900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.566482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.566968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.568056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6b2623b20f16432d986a95fc400d52b6) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.568577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.570777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.572802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c30dde-53a5-482f-a352-b6ef33cfceb1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.578122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 405/800] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/role_assignments?user.id=6b2623b20f16432d986a95fc400d52b6&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.578424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.579409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.579641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.579929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.580209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/eb5d649917c74d81b0c2fad7c2ba1028/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.591123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982c6d3-6973-4329-b81b-385113f9aa31 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.598556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=eb5d649917c74d81b0c2fad7c2ba1028, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.600495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.601300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.601844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.602364 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.602973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.603910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.606009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.620293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 12:52:10.622338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 406/802] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:10.622469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 396/802] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:10 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/eb5d649917c74d81b0c2fad7c2ba1028/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:52:10.630702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.710371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5ebfa-064b-4a99-8d46-1d72408bf196 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.715567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.716525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.717038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.717491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.718458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.718940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.720781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.730692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 397/803] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services?name=network => generated 124 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.733462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.749070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a569a7-73b0-4f57-b91d-204fdafd6a27 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.755460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.756481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.756985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.757455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.758409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.758889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.760770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.770781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 407/804] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.777571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.789003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac55f-5a66-43fb-a87b-0a55d9ff0485 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.794360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.795372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.795830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.796305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.797308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] RBAC: Adding query filter params (interface=public, service_id=3d8bc9ede86e485fa6182e2a3fa6d3d5, region_id=RegionOne) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:10.798454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.800276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55f6bc-6d6f-46b3-bde8-0bf482d24cfe admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.816754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 398/805] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/endpoints?service_id=3d8bc9ede86e485fa6182e2a3fa6d3d5&interface=public®ion_id=RegionOne => generated 194 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.823305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:10.835659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c2203-7a2f-49fc-9f6f-e0c107710c3e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:10.847707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd502501-81a3-43e0-8445-8ae4bb828e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:10.848765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd502501-81a3-43e0-8445-8ae4bb828e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.849263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd502501-81a3-43e0-8445-8ae4bb828e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.849766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd502501-81a3-43e0-8445-8ae4bb828e9f admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.850802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd502501-81a3-43e0-8445-8ae4bb828e9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:10.852776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd502501-81a3-43e0-8445-8ae4bb828e9f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:10.860526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 408/806] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:10 2021] GET /identity/v3/services => generated 772 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:10.958967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe53c6-460c-40c8-85ea-90913a81e845 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.959548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe53c6-460c-40c8-85ea-90913a81e845 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.960001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe53c6-460c-40c8-85ea-90913a81e845 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.962372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 399/807] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:10.968675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:10.968963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:10.969242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:10.989570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:10.990825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:10.999176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 409/808] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:10 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:11.023646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe53c6-460c-40c8-85ea-90913a81e845 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.037415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe53c6-460c-40c8-85ea-90913a81e845 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.042388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.043252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.043582 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.043860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.057091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:11.064440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:11.066078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 400/809] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:11.072824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.083393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf4498-8bc9-4030-8d40-5d78b6d11917 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.090573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.091298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.091599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.091868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.092635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:11.092935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.094558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.106668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 410/810] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:11.113682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.124180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145e68a-b859-4900-90e5-d889670f3d84 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.129807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.130863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.131370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.131851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.144769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.147005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.164856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:11.166737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 401/811] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:11.173201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.183576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bfadd-85b5-4201-824c-591983923b51 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.189094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.190028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.190514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.191010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.191991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:11.192480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.194346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.207873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 411/812] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:11.214126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.225105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ab48-1710-4893-8d3c-423a208c1014 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.229981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.231003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.231466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.231964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.241609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.243950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.258458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 12:52:11.260314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 402/813] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:11.266211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.283541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10a398-6828-4523-bc0c-f15c3ece3cf6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.294197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.294869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.295142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.295411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.296260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:11.296564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.299048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.329849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 412/814] 10.222.0.57 () {56 vars in 1156 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:11.335822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.346653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc904004-d7d9-4de4-80fc-bf48b51b9c89 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.357907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.359020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.359482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.359989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.373264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.375502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.396494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:11.398331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 403/815] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:11.404195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.424592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b8165-7bc2-4cce-af43-b80e4dcb82a2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.434339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.434997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.435286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.435546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.436286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:11.436586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.438199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.460676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 413/816] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:11.466706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.477515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36040f7f-ba22-4129-83e7-20b0e6af307b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.492416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.493488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.493972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.494467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.505061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.507320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.521809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:11.523340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 404/817] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:11.529683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.547408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f8358-86e2-43df-815c-2e949516f9a6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.567389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.568069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.568348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.568799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.569799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:11.570101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.571981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bbb5e-030f-430d-8abf-ef5cd354e242 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.591577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 414/818] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:11.599081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:11.612929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155eb4e-b90e-4cf9-8c74-f4a0c2009f8b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:11.620001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c625497-7ca7-455b-b1d9-be65aa0c902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:11.621181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625497-7ca7-455b-b1d9-be65aa0c902a admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:11.621678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625497-7ca7-455b-b1d9-be65aa0c902a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:11.622185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c625497-7ca7-455b-b1d9-be65aa0c902a admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/9eca15cf4b614f908d1e47baecadf6ed/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:11.624474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c625497-7ca7-455b-b1d9-be65aa0c902a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=9eca15cf4b614f908d1e47baecadf6ed, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:11.627369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c625497-7ca7-455b-b1d9-be65aa0c902a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:11.648597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 405/819] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:11 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/9eca15cf4b614f908d1e47baecadf6ed/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:52:13.470253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775be22-aa2b-4c26-b004-4863334f1150 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.471941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775be22-aa2b-4c26-b004-4863334f1150 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.472717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775be22-aa2b-4c26-b004-4863334f1150 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.476661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 415/820] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:13 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:13.498113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.498902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.498902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.527427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:13.528921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:13.612609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 406/821] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:13 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:13.684847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775be22-aa2b-4c26-b004-4863334f1150 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:13.721394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775be22-aa2b-4c26-b004-4863334f1150 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:13.731274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:13.732643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.733126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.733608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.734873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:13.737850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:13.763553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 15 12:52:13.770790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 416/822] 10.222.0.57 () {56 vars in 1150 bytes} [Wed Dec 15 12:52:13 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:13.780240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:13.798622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955a7b-bc59-4acf-9ce4-d1b0260d0cf1 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:13.811822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:13.812509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.812783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.813066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.813843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:13.814168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:13.822184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:13.840249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 407/823] 10.222.0.57 () {56 vars in 1145 bytes} [Wed Dec 15 12:52:13 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:13.850101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:13.877601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbdee7-1d69-40f8-a9e5-c8b100f13c1a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:13.889161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:13.890263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.890744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.891220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.893033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:13.893560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:13.896554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1613e-cf01-4e55-abfd-e239dd8a14cd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:13.909218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 417/824] 10.222.0.57 () {56 vars in 1145 bytes} [Wed Dec 15 12:52:13 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:13.919300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:13.946445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2b6f-02df-4de2-bbde-3b7557d2051a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:13.957309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:13.958007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.958303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.958573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.959371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:13.960434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:13.960434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:52:13.960434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:52:13.961307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:13.969804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1605d-8487-4290-b881-3016e5f62a91 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.970305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1605d-8487-4290-b881-3016e5f62a91 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.970773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1605d-8487-4290-b881-3016e5f62a91 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:13.974046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 418/825] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:13.983441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:13.983817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:13.984070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.004508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:14.004851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 408/826] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:13 2021] POST /identity/v3/endpoints => generated 346 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:14.005795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:14.038696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 419/827] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:13 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:14.083071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.102692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39a130-4dc3-4d19-9f41-6af5d5089943 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.112637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.113847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.114336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.114785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.139203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:14.147118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:52:14.148758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 409/828] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:14.158173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.180932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b3d7d-67ad-40e5-bb62-cb7735e8d6fa None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.197117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.198666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.199564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.200348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.201990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.202862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.206846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.227126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 420/829] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:14.232942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.245522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660b8e2-3314-4e3d-b24e-31a4de5de874 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.257383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.258261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.258547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.258865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.279041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.280905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.304870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:14.306178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 410/830] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:14.313849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.341336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e2102-e5e3-40be-b13b-005d0f846a91 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.359122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.360901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.361707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.362498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.364178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.364975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.368248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eb37c-fcff-4435-9357-478a56d54b9e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.395309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 421/831] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.400893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.413304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c8be-a005-493c-aa55-2a14a9e298e6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.422873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.424070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.424230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.424526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.433759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.436009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.447962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820869b-04f4-4eb2-922c-d35b76e476c4 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.448613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820869b-04f4-4eb2-922c-d35b76e476c4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.449118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820869b-04f4-4eb2-922c-d35b76e476c4 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.451357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 422/832] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:52:14.452142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8cc3954a-7b98-43da-9953-7f6b5f2a1516 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 12:52:14.452859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefe94-4531-44d8-8a97-7ba3571f0c64 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.453355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefe94-4531-44d8-8a97-7ba3571f0c64 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.453592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 411/833] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:14.454086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefe94-4531-44d8-8a97-7ba3571f0c64 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.457097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 423/834] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:14.459613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded43f-503a-4395-b4cd-553415476870 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.459954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded43f-503a-4395-b4cd-553415476870 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.460255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded43f-503a-4395-b4cd-553415476870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.463046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefe94-4531-44d8-8a97-7ba3571f0c64 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.480115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefe94-4531-44d8-8a97-7ba3571f0c64 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.481142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e1ded43f-503a-4395-b4cd-553415476870 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:14.482354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e1ded43f-503a-4395-b4cd-553415476870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:14.484627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.485859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.486139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.486475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.487350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.487676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.489691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.491288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 412/835] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:14 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:14.492568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.492855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.493124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.510312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 424/836] 10.222.0.57 () {56 vars in 1170 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:14.514552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.520071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:14.521261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:14.525586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b183d1-2922-48ce-8280-81c9206ed59d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.529133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 413/837] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:14 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:14.529934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.537939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.538836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.541076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.544004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.544695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.548735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.556083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a77e3-9d1f-4f8f-af3c-99ca2b3fc360 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.562199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.563096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.563607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.564078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.564997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 12:52:14.566742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 425/838] 10.222.0.57 () {56 vars in 1153 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:14.567639 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.574139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.576181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.583927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcecf-6ed7-46e2-85a6-045c4bc93873 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.588366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 414/839] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:14.589205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.589731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.590181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.590462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.590852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.591523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.593162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.601770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6751-284d-4aa0-88cd-236417ec6a76 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.606440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 15 12:52:14.606755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.607613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.613125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 426/840] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:14.613125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.613344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.613344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.613344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.613344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.614304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.623985 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 415/841] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.624205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d89c-2a39-4ad1-a81c-0b124fed3a80 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.625292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.636653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aba28f-2bd1-403c-a7d8-4a128b3c03ec admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.639231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.640232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.640632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.641016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.643279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.644370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.644832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.645659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.646589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] RBAC: Adding query filter params (name=network) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.647077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.648909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.654351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.660767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.660907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 416/842] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.660907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.672193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9715e-a00b-4422-bc51-0ca28de0b60f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.678125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.679032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.679469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.679880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.680808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.681290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.683278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.686131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:14.688289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 427/843] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:14.689384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.689720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 417/844] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.695619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.700707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda5aef-3e14-4bd5-a389-93af93e3cde4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.706344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.707222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.707681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.708088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.709012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.709475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.711692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.718093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328721a1-6e86-4c88-b653-26c336f61fdb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.726116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 428/845] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.728097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.730382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.731187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.731678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.732060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.733036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.733483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.736058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.748164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966bce-acb1-479b-a36a-2bd984692e66 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.761731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.762435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.762767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.763033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.763801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 418/846] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.763906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.764929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:14.764929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:52:14.764929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:52:14.765871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.767797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.786858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a1aa8-c371-4de5-af27-8760a8ced5e9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.791656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.792478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.792760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.793034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.802135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.804547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.821867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:14.823319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 419/847] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:14.830356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.832257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 429/848] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:14 2021] POST /identity/v3/endpoints => generated 327 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:14.841823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0888d1e-91f8-4055-9956-83fb1a872184 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.858302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.859091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.859488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.859835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.860713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.861025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.863142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3326-a4b4-4c16-80de-a80fc2604314 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.887714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 420/849] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:14.895320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:14.907034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02156e-4fda-4658-8a41-bc8b4cf62d57 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:14.912121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:14.912820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:14.913144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:14.913436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:14.914355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=eb5d649917c74d81b0c2fad7c2ba1028) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:14.914666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:14.916610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a02df-5874-4a92-9276-5ad4b0afc372 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:14.924180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 430/850] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:14 2021] GET /identity/v3/role_assignments?user.id=eb5d649917c74d81b0c2fad7c2ba1028&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:15.251854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb0f8-75d5-481c-baea-709730ecced2 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.252257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb0f8-75d5-481c-baea-709730ecced2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.252457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb0f8-75d5-481c-baea-709730ecced2 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.254550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 421/851] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:15.260712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.261001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.261282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.280628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:15.281838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:15.291949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 431/852] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:15 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:15.317263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb0f8-75d5-481c-baea-709730ecced2 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.331267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb0f8-75d5-481c-baea-709730ecced2 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.338302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.339094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.339374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.339650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.354758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:15.362374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:15.363564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 422/853] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:15.370617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.380406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c515c-da79-46bc-a9ab-95b1db632722 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.385070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.385731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.386009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.386368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.387127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:15.387425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.389078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.398394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 432/854] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:15.404756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.416028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3761d-f8aa-4632-8d95-ba5594fd185b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.420932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.421796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.422131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.423064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.434840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.436844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.456743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:15.461385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 423/855] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:15.464511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.475481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e53b83-4ab1-4a4e-af2d-e2369c7d0ff6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.480501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.481222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.481577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.481914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.482802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:15.483190 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.484924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.499013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 433/856] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:15.505374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.519978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf50ad0-2f4b-4cce-9588-2bd6c708227b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.525053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.526567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.527046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.527512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.536080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.538358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.555206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 15 12:52:15.557339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 424/857] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:15.563511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.574113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef55d6-fb3c-43bb-bf5b-5cd11950f199 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.578606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.579294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.579573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.579904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.580779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:15.581093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.582966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.601167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 434/858] 10.222.0.57 () {56 vars in 1156 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:15.607280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.617451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f194c2-db4d-4df0-8975-ea45874885f8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.621935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.622603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.622934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.623207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.631975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.633975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.644526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 425/859] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:52:15.650816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.661687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74c771-516a-4efe-a2b7-820655e48223 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.666287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.667061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.667335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.667728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.683065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.684955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.702909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:15.704615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 435/860] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:15.710467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.719900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be8014-3a78-42ac-9c18-33c1263ba832 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.724508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.725197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.725474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.725791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.726550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:15.726849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.728430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.740435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 426/861] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:15.746711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.757975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093dc56-61aa-4138-99fb-62db818c60bb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.762816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.763687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.763969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.764243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.773300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.775319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.789959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:15.791590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 436/862] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:15.798987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.809235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09accc-9f40-4034-9f51-773b09aa4aac admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.814697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.815129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.815457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.815733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.816538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:15.816841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.818719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd0ac8-3676-46f1-9d0b-6eac22d55a2d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.832124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 427/863] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:15.838731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:15.850688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd4ac-9826-4e25-ab4f-616052c3cff5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:15.855668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:15.856347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:15.856820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:15.857228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:15.858111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=9eca15cf4b614f908d1e47baecadf6ed) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:15.858467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:15.860801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6749-ea38-424a-bb18-935523d6b696 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:15.868194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 437/864] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:15 2021] GET /identity/v3/role_assignments?user.id=9eca15cf4b614f908d1e47baecadf6ed&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:16.865758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb2f7-c98d-4ec5-a796-831479a76e59 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:16.866720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb2f7-c98d-4ec5-a796-831479a76e59 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:16.866720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb2f7-c98d-4ec5-a796-831479a76e59 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:16.868104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 428/865] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:52:16.873874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:16.874613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:16.874613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:16.892932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:16.894113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:16.902265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 438/866] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:16 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:16.925726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb2f7-c98d-4ec5-a796-831479a76e59 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:16.941518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb2f7-c98d-4ec5-a796-831479a76e59 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:16.949028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:16.950662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:16.951406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:16.952146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:16.953623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:16.956241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:16.956241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:52:16.956241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:52:16.958391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:16.980240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 12:52:16.982979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 429/867] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:16 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:16.989471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:16.998805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418cf9c-a3a7-4a9d-af96-f71f4bf908ec None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.003656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.004302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.004677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.004956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.005734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:17.006043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:17.007681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7361cf0-2a6e-4303-8235-11723b68154b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:17.012595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 439/868] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:16 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:17.019080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:17.028934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa106e-5656-40e9-b300-e55ec7bf3b49 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.033820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.034499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.034771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.035300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.036027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:17.036327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:17.037902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef1c31-5b18-44ea-8596-1628b7e28df4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:17.042844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 430/869] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:17 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:17.721925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac376d-efc3-4862-bc18-8af33d51a14c None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.722616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac376d-efc3-4862-bc18-8af33d51a14c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.723094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac376d-efc3-4862-bc18-8af33d51a14c None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.725446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 440/870] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:17.731742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.732289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.732754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.751412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:17.752922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:17.760706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 431/871] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:17 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:17.785395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac376d-efc3-4862-bc18-8af33d51a14c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:17.798390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac376d-efc3-4862-bc18-8af33d51a14c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.802995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.804023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.804519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.805003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.816216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:17.824562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 12:52:17.830249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 441/872] 10.222.0.57 () {56 vars in 1141 bytes} [Wed Dec 15 12:52:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:17.833361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:17.842638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9af34-ac6a-47cb-9082-c47ca0463af4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.847395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.848265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.848761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.849241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.850268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:17.850764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:17.852523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de9576-0b18-4823-9d14-a09f66966123 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:17.867672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 432/873] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:52:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:17.869747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:17.894102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac7062-30c4-4175-b3e9-2e53fbee8fda admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.895720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250128bb-bc29-47f0-830e-d9791a61a948 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.896022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250128bb-bc29-47f0-830e-d9791a61a948 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.896354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250128bb-bc29-47f0-830e-d9791a61a948 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.898967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 433/874] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:17.902695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.903791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.904278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.904771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.905827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.906455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.907082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.917873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:17.919782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:17.928873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:17.930731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:17.950236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 434/875] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:17 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:17.956372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:17.962298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 442/876] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:17.964021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:17.973710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b85e6-e84b-4f5b-b2a8-4121c5c856c4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.978403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.979285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:17.982948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.983534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.984006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.985001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:17.985608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:17.988040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:17.988929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30e516-53ea-4d7f-8f87-90c27ad62864 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:17.993629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:17.994477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:17.994894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:17.995332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:17.996288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:17.997431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:17.997431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:52:17.997431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:52:17.998624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.005398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 435/877] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:18.015438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.018853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 443/878] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:17 2021] POST /identity/v3/services => generated 269 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:18.030399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f95537-f9c3-46d3-a032-0142dc1aef6b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.046598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.047916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.048375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.048861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.060954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.065400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.086652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 12:52:18.093681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 436/879] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:18.096122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.107233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5c0c-21c9-4842-b4f9-669c308a4608 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.112312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.113349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.113804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.114353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.115393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:18.115906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.117981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.138563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 444/880] 10.222.0.57 () {56 vars in 1170 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:18.145440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.155686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002a27e-ca06-4996-8797-07d82f36518e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.161523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.162530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.163031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.163507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.172775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.174948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.190285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 437/881] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:52:18.193240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.203742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78281a77-db8a-47e1-aa59-a7f67190a786 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.208956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.210031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.210632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.211076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.223659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.225925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.245575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:18.247327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 445/882] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:18.255280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.269571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440acc7-9b93-4a2a-b880-62f8d9382c5d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.278425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.279396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.279820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.280233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.281390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:18.282402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.285186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.305414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 438/883] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:18.311038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.321222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bec801-a9f3-4c5f-9fd0-db38449a26a8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.325764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.326633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.326910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.327177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.334979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.337002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.351531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:18.356146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 446/884] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:18.360606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.371637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04a86-6196-49cb-af94-1f658a637912 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.376280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.376920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.377197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.377468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.378344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:18.378650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.380589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d6b28-faaa-4fd5-b9f1-4b6eec59720c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.398301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 439/885] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:18.399988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:18.410998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8fc8e-4673-4c5c-8d76-6c8871a5ae3b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:18.415647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:18.416348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:18.416624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:18.416934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:18.417943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] RBAC: Adding query filter params (role.id=223d3a98917a457aa1ef0641be5e5c4e, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=eb5d649917c74d81b0c2fad7c2ba1028) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:18.418288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:18.420327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8650-2a5a-49a3-9076-05cbdf03b787 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:18.431039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 447/886] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:18 2021] GET /identity/v3/role_assignments?user.id=eb5d649917c74d81b0c2fad7c2ba1028&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=223d3a98917a457aa1ef0641be5e5c4e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:19.255269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825fdf9-a3b2-4d8e-a468-8eb80b86bd53 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.256000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825fdf9-a3b2-4d8e-a468-8eb80b86bd53 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.256000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825fdf9-a3b2-4d8e-a468-8eb80b86bd53 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.257842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 440/887] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:19.267231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.268643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.269327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.295168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:19.298105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:19.310862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 448/888] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:19 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:19.348792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825fdf9-a3b2-4d8e-a468-8eb80b86bd53 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:19.367524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825fdf9-a3b2-4d8e-a468-8eb80b86bd53 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:19.374368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:19.375907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.376614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.377282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.378608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:19.381450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:19.400367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 12:52:19.403073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 441/889] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:19.413450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:19.428003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5848a-aae8-40a3-b4c1-be09746608a8 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:19.435903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:19.437268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.438612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.439389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.440749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:19.441389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:19.443991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c907f3-3384-4961-b87b-52f2ef592367 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:19.450451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 449/890] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:19.458408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:19.468626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ff7f8-68a6-4765-9de2-4ab7ce6314b9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:19.474216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:19.475118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.475629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.476100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.477016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:19.477532 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:19.479369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e69a0-b071-421f-89c5-9bc1f759f36d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:19.484575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 442/891] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:19 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:19.499869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb90ea-ed3f-4a2f-8216-18705874543c None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.501049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb90ea-ed3f-4a2f-8216-18705874543c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.501539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb90ea-ed3f-4a2f-8216-18705874543c None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.503688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 450/892] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:52:19.512750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84bd3-4c78-416b-b17e-66ceacd908da None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.513356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84bd3-4c78-416b-b17e-66ceacd908da None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.513838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb84bd3-4c78-416b-b17e-66ceacd908da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.535938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4cb84bd3-4c78-416b-b17e-66ceacd908da None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:19.537409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4cb84bd3-4c78-416b-b17e-66ceacd908da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:19.546027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 443/893] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:19 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:19.570175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb90ea-ed3f-4a2f-8216-18705874543c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:19.594679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb90ea-ed3f-4a2f-8216-18705874543c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:19.596487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c45c88-7302-43b3-8ea8-94e34fddc837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:19.597203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45c88-7302-43b3-8ea8-94e34fddc837 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:19.597482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45c88-7302-43b3-8ea8-94e34fddc837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:19.597849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c45c88-7302-43b3-8ea8-94e34fddc837 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:19.598701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c45c88-7302-43b3-8ea8-94e34fddc837 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:19.600436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c45c88-7302-43b3-8ea8-94e34fddc837 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:19.617131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 451/894] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:19 2021] POST /identity/v3/services => generated 251 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:20.848184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd484f2-3230-48aa-a3cf-0ce8cd5772da None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:20.848705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd484f2-3230-48aa-a3cf-0ce8cd5772da None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:20.848815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd484f2-3230-48aa-a3cf-0ce8cd5772da None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:20.850969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 444/895] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:20.857063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:20.857520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:20.857609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:20.877076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:20.878609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:20.902298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 452/896] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:20 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:20.922830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd484f2-3230-48aa-a3cf-0ce8cd5772da None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:20.935793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd484f2-3230-48aa-a3cf-0ce8cd5772da None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:20.940761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:20.941564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:20.941842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:20.942111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:20.942804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:20.944417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:20.956380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 12:52:20.962317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 445/897] 10.222.0.57 () {56 vars in 1153 bytes} [Wed Dec 15 12:52:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:20.964541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:20.974305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b4037-6913-4c2d-adb3-d87e984c01d1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:20.978984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:20.979779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:20.980112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:20.980420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:20.981144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:20.981447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:20.983057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:20.993286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 453/898] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:20.994643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.005100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a65-f3af-44fa-91b5-8a6a5a487e38 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.009840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.010522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.010801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.011072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.011824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.012122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.013715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00ec24-96b3-4076-9088-92dc6ecb419b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.024608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 446/899] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:21.025975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.036674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754553a-954c-4db0-bfe2-2c96e9c2845d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.041217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.041861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.042155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.042448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.043245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] RBAC: Adding query filter params (interface=public, service_id=d91f81bd12b540e48da17bca61390021, region_id=RegionOne) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.043597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.044728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:21.044728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:52:21.044728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:52:21.046097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.059779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 454/900] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/endpoints?service_id=d91f81bd12b540e48da17bca61390021&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:21.064483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e309-37e5-4903-98f7-5b65c552cdc8 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.064715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e309-37e5-4903-98f7-5b65c552cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.064995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e309-37e5-4903-98f7-5b65c552cdc8 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.067219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 447/901] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:21.067908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.073995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.074361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.074684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.083209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2269f-d22e-48d8-be8d-4ab05bd73d52 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.087827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.088483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.088761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.089030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.089718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.091334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.094546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:21.096224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:21.101963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 455/902] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/services => generated 1268 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:52:21.114010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 448/903] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:21 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:21.139135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.150919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0124d2-7667-438c-8e75-425ed5922c79 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.155869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.157351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.157676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.157998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.171013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:21.179582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 12:52:21.181432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 456/904] 10.222.0.57 () {56 vars in 1141 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:21.188970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.199701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e36242-a20e-44f3-b717-5e03549cc62f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.205670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.206397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.206680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.206953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.207741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.208045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.209720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.220694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 449/905] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:21.226985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.237796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957726-d55d-43bc-8d7a-d1019d262367 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.242728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.243534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.243815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.244088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.256230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.258185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.278727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:21.280544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 457/906] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:21.287242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.298507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedbd77-9a69-4840-930b-3f5fb56836e5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.303369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.304063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.304344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.304617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.305378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.305684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.307440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.321304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 450/907] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:21.327604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.345484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49da118-cc76-4d9c-ba2c-f1364fb49299 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.350757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.351626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.351903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.352169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.361747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.365244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.387324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 12:52:21.387765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 458/908] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:21.406468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.425459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1c04-3d5c-4ca6-9436-81c91f6e08f6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.432492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.433476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.433917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.434375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.435740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.436167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.439861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.464162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 451/909] 10.222.0.57 () {56 vars in 1170 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:21.479184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.494959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95344e-1da8-43c3-b642-43c61ad3ec5c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.499798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.500888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.501245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.501589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.516283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.518829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.542986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:21.545821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 459/910] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:21.554125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.569265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557f27c-1d1e-49db-b400-36daf88107be admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.575933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.576972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.577464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.577905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.579177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.579654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.582351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.601810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 452/911] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:21.608858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.623655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47fb51-5c62-46db-85e4-238da18a1d7b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.629414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.630342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.630669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.630983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.639436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.641635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.657453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:21.659520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 460/912] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:21.668515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.683764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd83e-9eba-4164-8a91-617fcd741014 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.691976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.691976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.691976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.691976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.696922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:21.696922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.696922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30d9e-0d25-48ca-8364-5c535861c0db admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.710399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 453/913] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:21.718594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:21.732512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36356e-45c1-450a-89d4-faf9451085e3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:21.737645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd79aca-cc0b-4048-89d3-b8d7f2aa9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:21.738877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd79aca-cc0b-4048-89d3-b8d7f2aa9d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:21.739397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd79aca-cc0b-4048-89d3-b8d7f2aa9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:21.739841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd79aca-cc0b-4048-89d3-b8d7f2aa9d41 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/eb5d649917c74d81b0c2fad7c2ba1028/roles/223d3a98917a457aa1ef0641be5e5c4e` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:21.742339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd79aca-cc0b-4048-89d3-b8d7f2aa9d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=eb5d649917c74d81b0c2fad7c2ba1028, role_id=223d3a98917a457aa1ef0641be5e5c4e)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:21.745144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd79aca-cc0b-4048-89d3-b8d7f2aa9d41 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:21.760206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 461/914] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:21 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/eb5d649917c74d81b0c2fad7c2ba1028/roles/223d3a98917a457aa1ef0641be5e5c4e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:52:22.281984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206058-8855-4af1-88bf-3f4e8019b0cd None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.283065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206058-8855-4af1-88bf-3f4e8019b0cd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.283547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36206058-8855-4af1-88bf-3f4e8019b0cd None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.286067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 454/915] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:22.292055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.292469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.292654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.312022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:22.313777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:22.354683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293f7d-108f-4fa8-9a53-ec4059704fbd None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.354962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293f7d-108f-4fa8-9a53-ec4059704fbd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.355233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293f7d-108f-4fa8-9a53-ec4059704fbd None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.359006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 455/916] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:22.364124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.364406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.364679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.376309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 462/917] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:22 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:22.383935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:22.385114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:22.398249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 456/918] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:22 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:22.402939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:22.412482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc16b5-b821-4a05-8354-f21386e96e21 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:22.416982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:22.417246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:22.418075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.418407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.418692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.419357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:22.421389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:22.425993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b68e-4d75-4d23-99da-02f37bedf777 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:22.430551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:22.431251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.431525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.431793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.432574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:22.434231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:22.434433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 12:52:22.435748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 463/919] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:22 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:22.442836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:22.452975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d067f2-5db1-4527-addd-fe2d3c847335 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:22.458346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 457/920] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:22 2021] POST /identity/v3/services => generated 241 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:22.467820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:22.468494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.468771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.469625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.470381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:22.470690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:22.472350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:22.478246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 464/921] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:22 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:22.484482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:22.495123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb59ab8-27a2-4008-a968-5d8bb27322c0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:22.499894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:22.501141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.501424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.501698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.502476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:22.502778 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:22.504402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:22.510236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 458/922] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:22 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:22.516885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:22.527587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24651e-3316-4e5c-a82e-61bc4ab11e72 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:22.533036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:22.533632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.533907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.534207 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.535298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] RBAC: Adding query filter params (interface=public, service_id=75753b00ff4a4c6cb791c7891e52ac43, region_id=RegionOne) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:22.535607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:22.537227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5a3a-395b-4b06-8247-2a9d941c283b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:22.543582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 465/923] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:22 2021] GET /identity/v3/endpoints?service_id=75753b00ff4a4c6cb791c7891e52ac43&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:22.549758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:22.559855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4bbd0-47ad-4ca9-8a7e-c1b6d357367c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:22.565220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7db360-114b-4646-ae30-7831f99f9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:22.565895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db360-114b-4646-ae30-7831f99f9d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:22.566201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db360-114b-4646-ae30-7831f99f9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:22.566482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db360-114b-4646-ae30-7831f99f9d05 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:22.567198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db360-114b-4646-ae30-7831f99f9d05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:22.568804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7db360-114b-4646-ae30-7831f99f9d05 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:22.575386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 459/924] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:22 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:52:23.865213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad7b4-d710-405f-ac81-1dbbaa3e9cea None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:23.865923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad7b4-d710-405f-ac81-1dbbaa3e9cea None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:23.865923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad7b4-d710-405f-ac81-1dbbaa3e9cea None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:23.867709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 466/925] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:23.873815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:23.874372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:23.874532 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:23.894091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:23.895309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:23.903514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 460/926] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:23 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:23.928285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad7b4-d710-405f-ac81-1dbbaa3e9cea None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:23.940840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad7b4-d710-405f-ac81-1dbbaa3e9cea None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:23.945506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:23.946560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:23.947047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:23.947518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:23.948379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:23.950171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:23.965599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 15 12:52:23.968593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 467/927] 10.222.0.57 () {56 vars in 1153 bytes} [Wed Dec 15 12:52:23 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:23.975921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:23.987003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1c70-64b5-4d37-854b-4d7c114c8f12 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:23.991912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:23.992627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:23.992906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:23.993227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:23.993952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:23.994291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:23.996134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.002580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 461/928] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:23 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:24.008553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.019789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7c0e-771e-41ce-afdc-be6359efbb4d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.024611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.025478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.025951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.026460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.027381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.027901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.029741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a956193-95ea-432c-80b3-8fc6c3e2692d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.035568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 468/929] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:24.041893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.052384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54166979-bb46-4ddf-ba3f-ef6adbcb1935 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.057273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04939bf8-96bb-4a03-ad4e-0d95160764a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.058226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04939bf8-96bb-4a03-ad4e-0d95160764a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.058717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04939bf8-96bb-4a03-ad4e-0d95160764a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.059183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04939bf8-96bb-4a03-ad4e-0d95160764a7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.060204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04939bf8-96bb-4a03-ad4e-0d95160764a7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.062044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04939bf8-96bb-4a03-ad4e-0d95160764a7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.083267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 462/930] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:24 2021] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:24.254445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b2d9-f616-4272-9026-fd36428b6326 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.255157 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b2d9-f616-4272-9026-fd36428b6326 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.255654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b2d9-f616-4272-9026-fd36428b6326 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.258260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 469/931] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:24.264569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.264861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.265138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.284225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:24.285698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:24.305819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 463/932] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:24 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:24.331868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b2d9-f616-4272-9026-fd36428b6326 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.344917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5b2d9-f616-4272-9026-fd36428b6326 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.350350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.351185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.351463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.351737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.364090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:24.371657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 12:52:24.373218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 470/933] 10.222.0.57 () {56 vars in 1141 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:24.379812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.388860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e7413-6a5f-4242-aa03-3721e4915876 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.394111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.394808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.395089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.395361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.396154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.396455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.398043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.406892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 464/934] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:24.413351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.424226 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc316-5e53-4d71-a2e2-3c511ea2e780 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.428920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.429711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.429994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.430313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.441098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.443008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.462253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:24.463759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 471/935] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:24.469974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.480004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274682b-8cb0-4ffd-b1f5-afcec82657d4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.485283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.485999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.486313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.486591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.487336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.487642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.489298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.502338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 465/936] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:24.508501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.519305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5c568-17e8-4c28-b3c3-5781b993206d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.523990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.524794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.525096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.525371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.533322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.535737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.551524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 15 12:52:24.553185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 472/937] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:24.559875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.570586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822a17-0665-4a72-abb1-c9e8f9956131 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.580458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.581154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.581433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.581704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.582831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.583142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.585349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.607341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 466/938] 10.222.0.57 () {56 vars in 1170 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:24.613701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.623764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a07a9f-b5f7-4481-a105-2b84ccb01be0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.628942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.629571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.629851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.630122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.638388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.640145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.650267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 473/939] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:52:24.656437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.667512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb7a4a-1f10-4ade-9ea0-cf961010d2c6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.672153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.673058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.673408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.673746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.685486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.687348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.711855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:24.713381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 467/940] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:24.719767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.730178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356013fe-0c81-4b64-a2b2-ba1ce2029ab4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.735387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.736337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.736831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.737304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.738281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.738798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.740880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.763275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 474/941] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:24.771281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.782213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e17e-5a6f-46bf-8ec4-3d018d3dc3f7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.787307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.788097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.788375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.788644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.796383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.798383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.820466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:24.822096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 468/942] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:24.828245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.839901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b2e32-0056-4076-9749-72aeae986ee6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.845416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.846415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.846947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.847438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.848445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.849017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.851103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ae065-75e1-4920-8e5c-1f47c2b5a8e0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.865302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 475/943] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:24.872585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:24.883648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01a063-734d-40a7-89da-98a1ac31de57 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:24.889056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:24.890033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:24.890611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:24.891184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:24.892284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] RBAC: Adding query filter params (role.id=223d3a98917a457aa1ef0641be5e5c4e, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=eb5d649917c74d81b0c2fad7c2ba1028) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:24.892805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:24.894936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba428d-999c-4a59-9caa-7663f54403d0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:24.901982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 469/944] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:24 2021] GET /identity/v3/role_assignments?user.id=eb5d649917c74d81b0c2fad7c2ba1028&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=223d3a98917a457aa1ef0641be5e5c4e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:25.027466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ed8f-a4df-4af7-969e-4906a39a3419 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.027876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ed8f-a4df-4af7-969e-4906a39a3419 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.028325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ed8f-a4df-4af7-969e-4906a39a3419 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.030520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 476/945] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:25.037544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a065-2574-47b7-88d1-88903847f8ed None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.037835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a065-2574-47b7-88d1-88903847f8ed None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.038088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a065-2574-47b7-88d1-88903847f8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.056416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4f42a065-2574-47b7-88d1-88903847f8ed None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:25.057618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4f42a065-2574-47b7-88d1-88903847f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:25.066101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 470/946] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:25 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:25.090459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ed8f-a4df-4af7-969e-4906a39a3419 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.103292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ed8f-a4df-4af7-969e-4906a39a3419 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.107933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.108790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.109067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.109342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.110630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.112310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.124464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 12:52:25.126131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 477/947] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:25.128234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbc3bd-64fe-4ee8-8dad-f4dd35b7bc4e None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.128514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbc3bd-64fe-4ee8-8dad-f4dd35b7bc4e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.128788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbc3bd-64fe-4ee8-8dad-f4dd35b7bc4e None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.130909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 471/948] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:25.133414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.137469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.137749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.138024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.144397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe567-1ee2-4146-bbf1-a4d440424c90 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.150338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.150807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.151128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.151401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.152741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:25.153047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.155124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.157846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:25.159071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:25.161623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 478/949] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:25.168128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 472/950] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:25 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:25.171115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.181238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf99e9-6a4a-42f1-909c-5aef4a1c25d8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.186240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.187070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.187506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.187815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.188539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:25.188843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.191012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.194810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.200402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 479/951] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:25.201650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8d53d-87fe-4640-94d8-bfc4a0a80a72 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.207191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.207351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.208109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.208331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.208669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.209339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.211032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.217279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393ee4-9942-4b60-a630-494b50fbd9fc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.222322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 15 12:52:25.222744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.223382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.223534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 473/952] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:25.223941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.224212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.225008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] RBAC: Adding query filter params (interface=public, service_id=1f419b98ac4142589ba14d429efcff3d, region_id=RegionOne) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:25.225315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.227890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.229940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.233923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 480/953] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/endpoints?service_id=1f419b98ac4142589ba14d429efcff3d&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:25.241225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.242662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9945c-1a16-4df1-8f9d-04e8c3f5d3c9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.248126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.248837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.249064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.249340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.250100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:25.250480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.250924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dd1c9-7a1c-4495-9c63-74d7470aca8e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.252076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.256378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.257021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.257296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.257753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.257861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 474/954] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:25.258286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.259866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.264431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.268889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 481/955] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:52:25.278280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c95237-0081-48b0-b552-b508a7315a36 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.283374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.284120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.284451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.284721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.285789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:25.286093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.287863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77078e42-5d5f-464e-8180-e42c29382325 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.294370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 475/956] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Dec 15 12:52:25 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:25.305417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:25.324138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9cd5-4abe-4837-aa64-bb349bfac2ef admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:25.339500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d66f-601c-4c6f-b171-1b850afecb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:25.341020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d66f-601c-4c6f-b171-1b850afecb16 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:25.341271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d66f-601c-4c6f-b171-1b850afecb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:25.341547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d66f-601c-4c6f-b171-1b850afecb16 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:25.342410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0d66f-601c-4c6f-b171-1b850afecb16 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:25.344046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0d66f-601c-4c6f-b171-1b850afecb16 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:25.367270 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 482/957] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:25 2021] POST /identity/v3/endpoints => generated 346 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:26.763341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885b06b-33d4-4c45-b81c-8a9138566fbb None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:26.764325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885b06b-33d4-4c45-b81c-8a9138566fbb None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:26.764325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885b06b-33d4-4c45-b81c-8a9138566fbb None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:26.767793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 476/958] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:26.776900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:26.777598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:26.777598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:26.796096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:26.797829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:26.822187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 483/959] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:26 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:26.861784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885b06b-33d4-4c45-b81c-8a9138566fbb None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:26.885028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885b06b-33d4-4c45-b81c-8a9138566fbb None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:26.892759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:26.894066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:26.894573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:26.895038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:26.896349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:26.899286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:26.919753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 12:52:26.926293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 477/960] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:26 2021] GET /identity/v3/services/compute => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:26.932129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:26.942860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee81fc-696c-4ce4-9c37-94ea8e0313ef None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:26.947927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:26.948602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:26.948884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:26.949155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:26.949908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:26.950264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:26.951936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22097cf6-87bd-44ec-90f7-12fafdeb7ce6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:26.957939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 484/961] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:26 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:26.967757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:26.987244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882a6f-4bc4-4c2f-b0b8-4696358c3272 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:26.994161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:26.995154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:26.995575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:26.995986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:26.996975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:26.997508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:26.999859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e1c3c-0327-42bb-94b8-4fc71b6144d4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:27.009108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 478/962] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:26 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:27.657775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a96f-9a87-440a-b2e0-d0e1d86e1322 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:27.658347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a96f-9a87-440a-b2e0-d0e1d86e1322 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:27.658771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a96f-9a87-440a-b2e0-d0e1d86e1322 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:27.661437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 485/963] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:27.667816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:27.668245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:27.668620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:27.688152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:27.689450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:27.698134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 479/964] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:27 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:27.723833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5a96f-9a87-440a-b2e0-d0e1d86e1322 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:27.748883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5a96f-9a87-440a-b2e0-d0e1d86e1322 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:27.755388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:27.756419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:27.756757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:27.757032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] PATH_INFO: `/v3/services/image` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:27.757784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:27.759856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:27.777035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 12:52:27.779295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 486/965] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Dec 15 12:52:27 2021] GET /identity/v3/services/image => generated 86 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:27.788821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:27.802945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f810cc-6036-468d-b53a-b1dd046e6c6e None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:27.814660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:27.815747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:27.816268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:27.816706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:27.818064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:27.818608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:27.821415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19830dcc-ad24-4cd9-9ac1-2856b1336bb2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:27.829565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 480/966] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:27 2021] GET /identity/v3/services?name=image => generated 122 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:27.839394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:27.850287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb20c-efca-46e7-80a9-bed15dd74e4e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:27.854981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:27.855688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:27.855968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:27.856241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:27.856975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] RBAC: Adding query filter params (type=image) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:27.857274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:27.858938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f1ac-7153-4c3f-92ad-697b3c66215b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:27.864677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 487/967] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:27 2021] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:28.191067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d216-4d44-454c-a43c-bd8a764360b0 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.191499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d216-4d44-454c-a43c-bd8a764360b0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.191732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d216-4d44-454c-a43c-bd8a764360b0 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.193636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 481/968] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:28.199396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a85e-5858-42d4-a61b-fc5447f8d5d3 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.199823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a85e-5858-42d4-a61b-fc5447f8d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.200268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a85e-5858-42d4-a61b-fc5447f8d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.221221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4c74a85e-5858-42d4-a61b-fc5447f8d5d3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:28.222554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4c74a85e-5858-42d4-a61b-fc5447f8d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:28.230818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 488/969] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:28 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:28.255931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4d216-4d44-454c-a43c-bd8a764360b0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.269009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4d216-4d44-454c-a43c-bd8a764360b0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.273564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.274252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.274534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.274807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.275538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.277380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.278814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.common [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 15 12:52:28.292789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6f6b4-2bff-4f62-8053-129c8bf24f3e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.292789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6f6b4-2bff-4f62-8053-129c8bf24f3e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.292789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6f6b4-2bff-4f62-8053-129c8bf24f3e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.293613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 489/970] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:28.299321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.sql.core [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 15 12:52:28.299321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 15 12:52:28.299321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [parameters: {'id': '26dc004723204e598424f2d5c32333e6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 15 12:52:28.299321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79110) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 12:52:28.304493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.305057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.305602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.314989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26dc004723204e598424f2d5c32333e6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 26dc004723204e598424f2d5c32333e6. Dec 15 12:52:28.317720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 482/971] 10.222.0.57 () {60 vars in 1161 bytes} [Wed Dec 15 12:52:28 2021] POST /identity/v3/projects => generated 262 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:28.324864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.332957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:28.335002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:28.336539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660147a-b818-45bf-beb8-9ef44a3b3972 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.341360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.342282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.342477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.342828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.354363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 490/972] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:28 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:28.355704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.357997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.374302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:28.376128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 483/973] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:28.382600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.389624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.396218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063825-2e9d-4760-94c9-5c301777b4ab None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.407299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94531b-5014-44ee-be6d-e96f5e5fba1e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.408602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.409272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.409553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.410082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.410885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:28.411222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.413277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.429426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.430310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.430541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.430816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.431517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.433226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.449281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 12:52:28.450402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 484/974] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:28.453826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 491/975] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:28 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:28.463935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.488917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f3d04-c89c-4cb2-b695-3c605bb0b073 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.514943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.515785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.516067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.516338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.517073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:28.517375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.518998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.545582 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 485/976] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:28.555568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.588597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f71b26-7099-4552-9476-ed418e376fee admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.614934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.615621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.615903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.616171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.616904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:28.617211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.618878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74015-2a04-4bea-a030-c3c2299a55b9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.637798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 492/977] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:28.643842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:28.659691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ea0cc-19cf-42f0-9577-54efafa5725a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:28.672319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095f5ba-747c-4fdd-bb27-fe9ab938b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:28.674706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095f5ba-747c-4fdd-bb27-fe9ab938b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:28.676036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095f5ba-747c-4fdd-bb27-fe9ab938b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:28.676586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095f5ba-747c-4fdd-bb27-fe9ab938b4a4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:28.678266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095f5ba-747c-4fdd-bb27-fe9ab938b4a4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:28.683698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095f5ba-747c-4fdd-bb27-fe9ab938b4a4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:28.760130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 486/978] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:28 2021] POST /identity/v3/endpoints => generated 349 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:29.684712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8bb49-cc05-40ef-ace7-bfbae0785816 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:29.685273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8bb49-cc05-40ef-ace7-bfbae0785816 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:29.685273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8bb49-cc05-40ef-ace7-bfbae0785816 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:29.687384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 493/979] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:29.694194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64fac-bc83-4485-bf89-765b6ab0918a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:29.694634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64fac-bc83-4485-bf89-765b6ab0918a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:29.694731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca64fac-bc83-4485-bf89-765b6ab0918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:29.713330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-dca64fac-bc83-4485-bf89-765b6ab0918a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:29.715190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-dca64fac-bc83-4485-bf89-765b6ab0918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:29.732717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 487/980] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:29 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:29.758595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8bb49-cc05-40ef-ace7-bfbae0785816 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:29.771212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8bb49-cc05-40ef-ace7-bfbae0785816 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:29.775686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5980d7-375b-49e5-91db-775a5e694c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:29.776346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5980d7-375b-49e5-91db-775a5e694c7e admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:29.776630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5980d7-375b-49e5-91db-775a5e694c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:29.776907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5980d7-375b-49e5-91db-775a5e694c7e admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:29.777659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5980d7-375b-49e5-91db-775a5e694c7e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:29.779290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5980d7-375b-49e5-91db-775a5e694c7e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:29.795378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 494/981] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:29 2021] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:30.386756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccba48-d335-481e-95a3-460736987cfb None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:30.387166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccba48-d335-481e-95a3-460736987cfb None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:30.387350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccba48-d335-481e-95a3-460736987cfb None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:30.389373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 488/982] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:30.395897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c7eed-255e-4693-9ba0-8b9a23b66f83 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:30.396352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c7eed-255e-4693-9ba0-8b9a23b66f83 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:30.396631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c7eed-255e-4693-9ba0-8b9a23b66f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:30.415433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-923c7eed-255e-4693-9ba0-8b9a23b66f83 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:30.416650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-923c7eed-255e-4693-9ba0-8b9a23b66f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:30.434417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 495/983] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:30 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:30.458344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccba48-d335-481e-95a3-460736987cfb None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:30.471714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccba48-d335-481e-95a3-460736987cfb None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:30.476161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b16bc-bce8-412b-a8d3-89d544daa30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:30.476805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b16bc-bce8-412b-a8d3-89d544daa30b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:30.477080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b16bc-bce8-412b-a8d3-89d544daa30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:30.477350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b16bc-bce8-412b-a8d3-89d544daa30b admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:30.478082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b16bc-bce8-412b-a8d3-89d544daa30b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:30.479694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b16bc-bce8-412b-a8d3-89d544daa30b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:30.496531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 489/984] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:30 2021] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:31.336978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ab879-8630-4b8a-be62-8ad6d75e01c9 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.338010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ab879-8630-4b8a-be62-8ad6d75e01c9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.338547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ab879-8630-4b8a-be62-8ad6d75e01c9 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.340826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 496/985] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:31.347357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39c99-d1c8-4182-8f24-1bb5d3eef912 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.348223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39c99-d1c8-4182-8f24-1bb5d3eef912 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.348696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e39c99-d1c8-4182-8f24-1bb5d3eef912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.367065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-66e39c99-d1c8-4182-8f24-1bb5d3eef912 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:31.368552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-66e39c99-d1c8-4182-8f24-1bb5d3eef912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:31.390245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 490/986] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:31 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:31.410869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ab879-8630-4b8a-be62-8ad6d75e01c9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.415238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d5fe-e022-454f-8859-1d69473d1e74 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.415503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d5fe-e022-454f-8859-1d69473d1e74 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.415779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1d5fe-e022-454f-8859-1d69473d1e74 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.417840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 491/987] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:52:31.424273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.424556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.424829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.426600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ab879-8630-4b8a-be62-8ad6d75e01c9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.431467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.432486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.432989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.433468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.434386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.436217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.443840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:31.445137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:31.449770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 12:52:31.456947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 497/988] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:31.458556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 492/989] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:31 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:31.459346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.471621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f9294-df12-471f-9599-df479e6f582c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.476474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.477369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.477841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.478337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.479240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:31.479749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.481518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.486367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.492888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 498/990] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:31.494360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.496853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1669ef-cef8-4618-801e-1d23e0006d0b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.502022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.502957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.503438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.503917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.504740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d47e2-39c5-448e-9c30-eecc2a5420b4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.505070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.507227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.509242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.509885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.510180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.510465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.511176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:31.511474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.513030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.522462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.sql.core [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 15 12:52:31.522462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 15 12:52:31.522462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [parameters: {'user_id': '21c7b49cdcdd4838998a4268f95544bb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 15 12:52:31.522462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79110) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 15 12:52:31.523959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 499/991] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:31.525177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.529704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 15 12:52:31.531803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 493/992] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 12:52:31 2021] POST /identity/v3/users => generated 160 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:31.537492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e546e1-99b9-4a98-8cae-28e2ea0ee1d9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.538924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.540675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.541320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.541607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.541864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.542714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] RBAC: Adding query filter params (interface=admin, service_id=1f419b98ac4142589ba14d429efcff3d, region_id=RegionOne) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:31.543018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.544650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.551867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629880b-1e78-4640-9611-38144bd49648 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.554225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 500/993] 10.222.0.57 () {56 vars in 1270 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/endpoints?service_id=1f419b98ac4142589ba14d429efcff3d&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:31.559511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.561557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.563179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.563655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.564132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.570938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bed395-3bfc-4a9d-8583-b245f0bdd8a1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.573862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.575777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.576405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.576688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.576950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.577656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.577760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.580165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.593323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-dfd0defc-8e97-4ef0-b5de-e88826e1e217 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 15 12:52:31.593557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 501/994] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 12:52:31.595667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 494/995] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:31.602867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:31.613530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff74488-dd9b-443b-adc1-def40652660f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:31.618959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:31.620119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:31.620620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:31.621104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:31.622268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:31.622787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:31.625594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873afa-52d8-495a-9bef-962ea7c94b8b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:31.671419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 502/996] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Dec 15 12:52:31 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:32.348549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaae22-e501-44ae-a470-8a68b9045515 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.349084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaae22-e501-44ae-a470-8a68b9045515 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.349084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaae22-e501-44ae-a470-8a68b9045515 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.354026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 495/997] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:32 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:32.360284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.360732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.360806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.378784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:32.379962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:32.387785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 503/998] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:32 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:32.411901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaae22-e501-44ae-a470-8a68b9045515 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:32.423982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaae22-e501-44ae-a470-8a68b9045515 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:32.428594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:32.429399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.429680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.429951 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.430649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:32.432326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:32.444584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 12:52:32.445982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 496/999] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:32 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:32.452699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:32.462253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b97efa-4b5a-4b83-ae07-879f662d879f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:32.466740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:32.467455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.467801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.468137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.468953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:32.469313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:32.471016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:32.477683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 504/1000] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:32 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:32.483847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:32.494505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bfe25-1568-4a22-9c68-a194b28fcfcf admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:32.499167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:32.500334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.500611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.500878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.501593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:32.501890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:32.503495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:32.509063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 497/1001] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:32 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:32.515361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:32.533664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f8f2-0212-4662-97c7-1393c3efe9cd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:32.539607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:32.540368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.540704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.541055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.542245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] RBAC: Adding query filter params (interface=public, service_id=f8614ab3ff834203beeea9e563c1b16e, region_id=RegionOne) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:32.542627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:32.544710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd865-f64f-43ac-abea-05f676c2e52b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:32.551441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 505/1002] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:32 2021] GET /identity/v3/endpoints?service_id=f8614ab3ff834203beeea9e563c1b16e&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:32.557852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:32.568777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcff9f-08e7-4516-baf1-3b819e900e32 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:32.573464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e3d67-6b95-44b6-b50e-4acf6501903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:32.574136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e3d67-6b95-44b6-b50e-4acf6501903b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.574450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e3d67-6b95-44b6-b50e-4acf6501903b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.574816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e3d67-6b95-44b6-b50e-4acf6501903b admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.575523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e3d67-6b95-44b6-b50e-4acf6501903b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:32.577139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e3d67-6b95-44b6-b50e-4acf6501903b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:32.584513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 498/1003] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:32 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:52:32.967770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeffea-3095-42ec-8f53-ab87b0c1292e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.968082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeffea-3095-42ec-8f53-ab87b0c1292e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.968892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeffea-3095-42ec-8f53-ab87b0c1292e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.970908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 506/1004] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:32.977894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:32.978278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:32.978623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:32.996390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:32.997896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:33.005765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 499/1005] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:32 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:33.028808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeffea-3095-42ec-8f53-ab87b0c1292e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:33.041835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeffea-3095-42ec-8f53-ab87b0c1292e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:33.046215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:33.047021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:33.047302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:33.047573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:33.048229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:33.049805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:33.060609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 12:52:33.061938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 507/1006] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Dec 15 12:52:33 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:33.068531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:33.077303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfdf66-0c20-4789-895a-07c4857219aa None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:33.082491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:33.083150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:33.083432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:33.083734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:33.084487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:33.084811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:33.086490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:33.091466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 500/1007] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:33 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:33.097470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:33.107090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530a2a-984f-4683-9fee-5886af6fce21 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:33.111565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:33.112205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:33.112484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:33.112758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:33.113481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] RBAC: Adding query filter params (type=image) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:33.113786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:33.115395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:33.120146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 508/1008] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:33 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:33.126443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:33.135823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd771a1a-e226-4ded-98ff-d45704526d17 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:33.140282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:33.140945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:33.141228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:33.141504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:33.142329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] RBAC: Adding query filter params (interface=public, service_id=2be72e967eaf4028b6cacd29db0780e5, region_id=RegionOne) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:33.142641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:33.144211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8f283-6964-46ae-a522-a0cc68f769f4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:33.149125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 501/1009] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:52:33 2021] GET /identity/v3/endpoints?service_id=2be72e967eaf4028b6cacd29db0780e5&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:33.154538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:33.164559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75d142-4e10-4683-8b71-eb826f5dd36e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:33.169211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc6c3f-7b1d-4bde-8fcd-117f82c9a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:33.169833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6c3f-7b1d-4bde-8fcd-117f82c9a90b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:33.170111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6c3f-7b1d-4bde-8fcd-117f82c9a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:33.170427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc6c3f-7b1d-4bde-8fcd-117f82c9a90b admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:33.171105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc6c3f-7b1d-4bde-8fcd-117f82c9a90b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:33.173248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc6c3f-7b1d-4bde-8fcd-117f82c9a90b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:33.179726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 509/1010] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:52:33 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 12:52:34.040113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f7fd-7c7f-4272-929f-a305f4ee9462 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.040622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f7fd-7c7f-4272-929f-a305f4ee9462 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.040699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f7fd-7c7f-4272-929f-a305f4ee9462 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.042625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 502/1011] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:34.048432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.048827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.048985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.066368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:34.067480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:34.075177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 510/1012] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:34 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:34.099051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f7fd-7c7f-4272-929f-a305f4ee9462 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:34.111614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f7fd-7c7f-4272-929f-a305f4ee9462 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:34.115928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:34.116736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.117026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.117312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.118004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:34.119679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:34.130934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 15 12:52:34.132299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 503/1013] 10.222.0.57 () {56 vars in 1147 bytes} [Wed Dec 15 12:52:34 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:34.138554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:34.147971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8aa9-6d9b-49f5-af8a-ee085a2bebca None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:34.152478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:34.153321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.153684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.154022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.154823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:34.155186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:34.157438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:34.166176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 511/1014] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:34 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:34.168339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:34.177784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2b296-a34c-4d20-a7bc-8d6cb6d63bee admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:34.183355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:34.184038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.184322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.184596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.185336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:34.185643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:34.187327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a6c2e-2bcb-4ba0-a405-171da2b6a896 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:34.196093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 504/1015] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Dec 15 12:52:34 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:34.203668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:34.216202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271831c-3e03-41a7-92ea-997fc1b1c5b9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:34.221300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34fb7f-59de-47bc-890b-db23e58bbdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:34.221953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34fb7f-59de-47bc-890b-db23e58bbdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.222274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34fb7f-59de-47bc-890b-db23e58bbdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.222554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34fb7f-59de-47bc-890b-db23e58bbdf7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.223320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34fb7f-59de-47bc-890b-db23e58bbdf7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:34.224897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34fb7f-59de-47bc-890b-db23e58bbdf7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:34.240260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 512/1016] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:34 2021] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:34.943793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798f2c-7e8e-4640-aed4-8b8839b293ba None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.944173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798f2c-7e8e-4640-aed4-8b8839b293ba None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.944352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf798f2c-7e8e-4640-aed4-8b8839b293ba None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.946287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 505/1017] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:34.951932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:34.952221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:34.952496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:34.972282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:34.973468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:34.990600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 513/1018] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:34 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:35.013878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf798f2c-7e8e-4640-aed4-8b8839b293ba None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.026363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf798f2c-7e8e-4640-aed4-8b8839b293ba None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.030663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.031513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.031789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.032062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.032729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.034343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.045709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 15 12:52:35.047646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 506/1019] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:35 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:35.053985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.064032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640d238-61be-4da3-8511-252ba5d37051 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.068629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.069358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.069711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.070054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.070880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:35.071251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.072933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.078203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 514/1020] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:35 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:35.084459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.095135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc155b36-91f0-47af-b697-d2a8547af483 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.099931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.100594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.100877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.101152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.102027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:35.102243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.103810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cab0f-39d2-422f-b516-0381ca9c796c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.109868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 507/1021] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Dec 15 12:52:35 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:35.116134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.126490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cdfb6-c816-4fd0-b621-167010ab33f6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.131066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84fd9b-2744-45d3-8338-1e7f21364987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.131719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84fd9b-2744-45d3-8338-1e7f21364987 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.131997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84fd9b-2744-45d3-8338-1e7f21364987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.132268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84fd9b-2744-45d3-8338-1e7f21364987 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.133034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84fd9b-2744-45d3-8338-1e7f21364987 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.134651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84fd9b-2744-45d3-8338-1e7f21364987 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.154520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 515/1022] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:35 2021] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:35.567075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a65fee-cd63-407e-8eb9-ce83829e8d64 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.567480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a65fee-cd63-407e-8eb9-ce83829e8d64 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.567669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a65fee-cd63-407e-8eb9-ce83829e8d64 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.569471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 508/1023] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:35.575702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.575988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.576261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.594833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:35.596014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:35.613210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 516/1024] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:35 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:35.636432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a65fee-cd63-407e-8eb9-ce83829e8d64 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.649356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a65fee-cd63-407e-8eb9-ce83829e8d64 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.653946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.654769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.655040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.655307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.656517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.658458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.669485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 15 12:52:35.670910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 509/1025] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Dec 15 12:52:35 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:35.677295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.688689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6e08-7163-4b7c-ae4d-cbc8c64bc9fd None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.693545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.694710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.695292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.695870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.697242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] RBAC: Adding query filter params (name=image) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:35.697806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.700170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.705616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 517/1026] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:35 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:35.712208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.724583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414db617-1e41-4733-b78c-ecc937a37b63 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.729945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.730754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.731065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.731446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.732268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] RBAC: Adding query filter params (type=image) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:35.732661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.734488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec320cf-fafd-4651-aa1e-d66a296275ce admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.740620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 510/1027] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:35 2021] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:35.746862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:35.756461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28215a54-735c-433b-a6b5-8b22d556282d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:35.761041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a21cf-7ecd-4029-b68a-16732c86452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:35.761756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a21cf-7ecd-4029-b68a-16732c86452b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:35.762103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a21cf-7ecd-4029-b68a-16732c86452b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:35.762487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a21cf-7ecd-4029-b68a-16732c86452b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:35.763285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a21cf-7ecd-4029-b68a-16732c86452b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:35.764926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a21cf-7ecd-4029-b68a-16732c86452b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:35.784271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 518/1028] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:52:35 2021] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:36.652604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42c29-6c26-4b56-91f9-28203c9f622d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:36.653137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42c29-6c26-4b56-91f9-28203c9f622d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:36.653137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42c29-6c26-4b56-91f9-28203c9f622d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:36.654972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 511/1029] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:36.662076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:36.662584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:36.662678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:36.682766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:36.682766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:36.711980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 519/1030] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:36.737801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42c29-6c26-4b56-91f9-28203c9f622d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:36.758499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42c29-6c26-4b56-91f9-28203c9f622d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:36.764503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71916818-f396-4b4a-8c1c-732323a0b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:36.766267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916818-f396-4b4a-8c1c-732323a0b669 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:36.766682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916818-f396-4b4a-8c1c-732323a0b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:36.767090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71916818-f396-4b4a-8c1c-732323a0b669 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:36.768784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71916818-f396-4b4a-8c1c-732323a0b669 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:36.771422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71916818-f396-4b4a-8c1c-732323a0b669 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:36.778176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 512/1031] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:36.780646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:36.790468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ee6c-9537-46f8-b14f-71a5fed10713 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:36.795090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd40f3-da0d-427d-8423-df8ed9537bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:36.795812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd40f3-da0d-427d-8423-df8ed9537bdf admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:36.796170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd40f3-da0d-427d-8423-df8ed9537bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:36.796518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd40f3-da0d-427d-8423-df8ed9537bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:36.797317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd40f3-da0d-427d-8423-df8ed9537bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:36.799309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd40f3-da0d-427d-8423-df8ed9537bdf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:36.840384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 520/1032] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:52:36 2021] POST /identity/v3/projects => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:52:37.798403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572a1a-9193-4d7a-8f2d-0fa7eae5c030 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:37.798923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572a1a-9193-4d7a-8f2d-0fa7eae5c030 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:37.799000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5572a1a-9193-4d7a-8f2d-0fa7eae5c030 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:37.800739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 513/1033] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:37.807390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:37.808162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:37.808600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:37.828609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:37.829806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:37.888522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 521/1034] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:37.914173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5572a1a-9193-4d7a-8f2d-0fa7eae5c030 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:37.926483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5572a1a-9193-4d7a-8f2d-0fa7eae5c030 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:37.930840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:37.931630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:37.931908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:37.932179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:37.943162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:37.950532 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 12:52:37.951947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 514/1035] 10.222.0.57 () {56 vars in 1141 bytes} [Wed Dec 15 12:52:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:37.961242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:37.974521 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37f24-2f41-4487-bd67-e588db5781a1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:37.981262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:37.982003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:37.982322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:37.982600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:37.983385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:37.983692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:37.985835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:37.995945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 522/1036] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:52:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:38.007649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.021889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15afc-4452-49ef-97c8-6cadcb7d23dc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.027764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.028552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.028836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.029113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.040241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.042170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.061624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:38.063536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 515/1037] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:38.069894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.080217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f7ab-b9d8-4168-8db4-774da92e4d28 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.084853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.085569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.085927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.086319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.087127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:38.087500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.089161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.102582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 523/1038] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:38.107583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.117251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80524839-f857-454d-ae90-9eae8f06a815 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.121953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.122780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.123063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.123333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.130827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.132837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.147058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:52:38.148383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 516/1039] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:38.154557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.165197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828aed-f219-4342-ad49-dfd0f8a8604e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.169712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.170410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.170693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.170987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.171878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:38.172223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.174082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.208807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 524/1040] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:38.210134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.219785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443c82d-a4f2-4386-b723-bbea6f005cdb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.224315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090002-fe4d-49c0-8326-bb754b827a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.224947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090002-fe4d-49c0-8326-bb754b827a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.225226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090002-fe4d-49c0-8326-bb754b827a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.225495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090002-fe4d-49c0-8326-bb754b827a0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.233316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78090002-fe4d-49c0-8326-bb754b827a0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.235145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78090002-fe4d-49c0-8326-bb754b827a0e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.244082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 517/1041] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:38.250507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.252527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f835f-399f-4b77-992e-69b412bd5726 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.252816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f835f-399f-4b77-992e-69b412bd5726 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.253092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f835f-399f-4b77-992e-69b412bd5726 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.255014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 518/1042] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:52:38.260498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569389-2649-493b-a2cc-918982437d4f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.260705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b4fc5-2df7-4e4f-8813-fdc4a5430165 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.260793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569389-2649-493b-a2cc-918982437d4f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.261141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d569389-2649-493b-a2cc-918982437d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.265946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.266765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.267046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.267319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.277790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.279690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.279800 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6d569389-2649-493b-a2cc-918982437d4f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:38.280933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6d569389-2649-493b-a2cc-918982437d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:38.289185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 519/1043] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:38.297216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:38.298555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 525/1044] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:38.304901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569389-2649-493b-a2cc-918982437d4f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.318699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.321097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d569389-2649-493b-a2cc-918982437d4f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.327465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.328691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.328965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.329236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.329994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:38.330331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.332109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.333450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc5fc8-ddf3-43f0-ab12-c9acc429fd53 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.338938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.339645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.340657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.340657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.352700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.354820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.358645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 520/1045] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:38.362858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.377101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 526/1046] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:52:38.377328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db2eef-1fc1-4536-bd17-6c5b62924525 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.379294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.384186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.385015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.385424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.386300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.390928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df146b2-5642-4fde-ac00-45a58efde265 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.396654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.397207 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.398421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.398869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.399248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.399986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.401050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.403480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.405971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 527/1047] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:38.420167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:38.421908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 521/1048] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:38.428987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.440965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e4e8-d0bd-429d-bd08-29062b95dac8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.447690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.448861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.449260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.449753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.451227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:38.451725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.454988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04711c00-9dd1-4fb5-b751-77c8c6b5e906 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.474205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 528/1049] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:38.481339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:38.496444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3caae-4e80-4c5c-b4a3-a14f80b029e6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:38.503769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:38.504735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:38.505147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:38.505550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:38.506939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] RBAC: Adding query filter params (role.id=223d3a98917a457aa1ef0641be5e5c4e, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6b2623b20f16432d986a95fc400d52b6) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:38.507414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:38.510394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc0cc3-5da9-453a-a84b-5abe9be74419 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:38.519586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 522/1050] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:38 2021] GET /identity/v3/role_assignments?user.id=6b2623b20f16432d986a95fc400d52b6&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=223d3a98917a457aa1ef0641be5e5c4e => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:39.365395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf482-635f-4a0e-aef5-3a18d4b763e5 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:39.365950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf482-635f-4a0e-aef5-3a18d4b763e5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:39.365950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bf482-635f-4a0e-aef5-3a18d4b763e5 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:39.367723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 529/1051] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:39.373835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:39.374504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:39.374504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:39.392445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:39.393645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:39.401542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 523/1052] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:39.431238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf482-635f-4a0e-aef5-3a18d4b763e5 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:39.447181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bf482-635f-4a0e-aef5-3a18d4b763e5 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:39.451740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd3b0-206e-4703-b222-6e06222ff976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:39.453024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd3b0-206e-4703-b222-6e06222ff976 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:39.453299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd3b0-206e-4703-b222-6e06222ff976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:39.453572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd3b0-206e-4703-b222-6e06222ff976 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:39.454778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd3b0-206e-4703-b222-6e06222ff976 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:39.456459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd3b0-206e-4703-b222-6e06222ff976 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:39.458484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 530/1053] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:39.464791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:39.475685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552565a0-c13f-4a86-93c8-0e18e182406c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:39.487600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1500b-3690-43bb-b908-4a02518d1cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:39.488598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1500b-3690-43bb-b908-4a02518d1cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:39.489017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1500b-3690-43bb-b908-4a02518d1cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:39.489455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1500b-3690-43bb-b908-4a02518d1cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:39.490787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1500b-3690-43bb-b908-4a02518d1cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:39.493605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1500b-3690-43bb-b908-4a02518d1cd2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:39.518730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 524/1054] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:52:39 2021] POST /identity/v3/users => generated 285 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:40.949475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119588-bcb2-43dc-9d64-50b3e41542f5 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:40.950049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119588-bcb2-43dc-9d64-50b3e41542f5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:40.950049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb119588-bcb2-43dc-9d64-50b3e41542f5 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:40.951984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 531/1055] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:40.957995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:40.958507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:40.958596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:40.976983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:40.978190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:40.986256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 525/1056] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:41.011390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb119588-bcb2-43dc-9d64-50b3e41542f5 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.026441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb119588-bcb2-43dc-9d64-50b3e41542f5 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.030697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.031485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.031757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.032020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.042367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:41.050184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 12:52:41.051493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 532/1057] 10.222.0.57 () {56 vars in 1141 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:41.059065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.068570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0fa0c-be03-4b63-b726-79f5fde4c5d0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.073214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.073976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.074294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.074566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.075326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:41.075619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.077226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.086440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 526/1058] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:41.092873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.103355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b832-25e5-4afb-9a33-c41e5a6327d8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.107918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.109238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.109512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.109777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.120274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.122109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.139060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:41.140780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 533/1059] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:41.147923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.165660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026cb67-bbeb-489f-a4a0-4dd20205d843 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.172981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.174075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.174704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.175191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.176511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:41.177054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.180174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.195213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 527/1060] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:41.201456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.211084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ce5c0-e783-42f4-a351-a796ebc87cd1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.215499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.216259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.216532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.216797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.224642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.226680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.240736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:52:41.241895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 534/1061] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:41.248151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.258019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b95f54-8603-4270-a7e3-c69fe073607c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.262531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.263190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.263472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.263745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.264593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:41.264899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.266966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.285060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 528/1062] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:41.291325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.301484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557a62-29c4-46c5-9552-49ec2fc95a78 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.305882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.306740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.307016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.307282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.317304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.319202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.336367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:41.337517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 535/1063] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:52:41.344131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.354009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11236ab5-84a5-43a7-964f-d96def4a867d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.358678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.359896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.360239 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.360731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.363337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:41.363337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.363337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.378366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 529/1064] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:41.385193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.399328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354026a-25e4-44d7-9d02-7331db1436a7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.404451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.405262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.406032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.406344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.415470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.417430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.431273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:41.432814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 536/1065] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:41.439860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.450399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d476a-2db0-41ee-8bbe-61c140495c9f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.455261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.455919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.456200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.456475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.457285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:41.457593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.459531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6115e1-0a60-4d68-b24f-488b0c8d0b4d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.473076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 530/1066] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:41.479735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:41.490699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc978459-41e4-4a92-b6d4-f5af72f65819 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:41.495168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc171d2-e31a-41c9-af74-f65bd9cc7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:41.496040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc171d2-e31a-41c9-af74-f65bd9cc7aca admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:41.496403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc171d2-e31a-41c9-af74-f65bd9cc7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:41.496673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc171d2-e31a-41c9-af74-f65bd9cc7aca admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6b2623b20f16432d986a95fc400d52b6/roles/223d3a98917a457aa1ef0641be5e5c4e` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:41.499016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc171d2-e31a-41c9-af74-f65bd9cc7aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=6b2623b20f16432d986a95fc400d52b6, role_id=223d3a98917a457aa1ef0641be5e5c4e)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:41.501682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc171d2-e31a-41c9-af74-f65bd9cc7aca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:41.514134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 537/1067] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:41 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/6b2623b20f16432d986a95fc400d52b6/roles/223d3a98917a457aa1ef0641be5e5c4e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 12:52:42.030929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7f98-ca71-4f4b-a9b1-944df886466d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.031488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7f98-ca71-4f4b-a9b1-944df886466d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.031488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b7f98-ca71-4f4b-a9b1-944df886466d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.033244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 531/1068] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:42.039623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.040101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.040210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.057894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:42.059115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:42.115236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 538/1069] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:42.139305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7f98-ca71-4f4b-a9b1-944df886466d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:42.151268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b7f98-ca71-4f4b-a9b1-944df886466d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:42.156110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:42.156868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.157145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.157413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.167715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:42.175132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:42.176324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 532/1070] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:42.183091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:42.192072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4218af-b9ab-49d5-8577-75618d5864cf None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:42.196636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:42.197294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.197577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.197846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.198644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:42.198949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:42.200539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:42.209272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 539/1071] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:42.216031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:42.232403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7570ed-974d-4b89-b9cc-cc28954d1e80 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:42.240623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:42.242069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.242558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.243012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] PATH_INFO: `/v3/users/08d04eb7b0ed42c3858c523b05ab1a8d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.265068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] RBAC: Authorizing `identity:get_user(user_id=08d04eb7b0ed42c3858c523b05ab1a8d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:42.267272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:42.269032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 533/1072] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:42 2021] GET /identity/v3/users/08d04eb7b0ed42c3858c523b05ab1a8d => generated 285 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:42.275597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:42.286519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f58d4-7f35-4b62-b91e-77a6e175f970 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:42.291143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:42.291805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.292085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.292329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.301324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:42.303107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:42.312261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 540/1073] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:42 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:42.318792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:42.328790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bae3b0-4a73-454a-8140-815bdc84b6fb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:42.333275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d74c0-a872-4c64-96c2-326e28b1b938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:42.334110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d74c0-a872-4c64-96c2-326e28b1b938 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.334420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d74c0-a872-4c64-96c2-326e28b1b938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.334690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d74c0-a872-4c64-96c2-326e28b1b938 admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.335852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d74c0-a872-4c64-96c2-326e28b1b938 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d6c5d7e8a0b42a69fa8fe027598d177)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:42.337868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d74c0-a872-4c64-96c2-326e28b1b938 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:42.339545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 534/1074] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:52:42 2021] GET /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:42.346573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:42.355383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af89aa3-6292-4153-9e83-38dd66bc00c5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:42.359909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:42.360536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:42.360810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:42.361077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:42.361900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177, user.id=08d04eb7b0ed42c3858c523b05ab1a8d) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:42.362236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:42.364061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f90a9-4194-4f30-9a80-25464dabb6bb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:42.369457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 541/1075] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:42 2021] GET /identity/v3/role_assignments?user.id=08d04eb7b0ed42c3858c523b05ab1a8d&scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:43.940807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f500500-8249-47d6-89b5-ff527abedeb8 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:43.941375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f500500-8249-47d6-89b5-ff527abedeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:43.941724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f500500-8249-47d6-89b5-ff527abedeb8 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:43.944934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 535/1076] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:43.951362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:43.952071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:43.952071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:43.972386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:43.973583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:43.981650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 542/1077] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:44.006659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f500500-8249-47d6-89b5-ff527abedeb8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.019288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f500500-8249-47d6-89b5-ff527abedeb8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.023867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.024674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.024953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.025224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.036489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:44.043744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 15 12:52:44.044919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 536/1078] 10.222.0.57 () {56 vars in 1141 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:44.051525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.060294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b519b0-a131-40a1-80a1-7707ebc9aed2 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.065037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.065632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.065907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.066208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.066960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.067257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.068830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.076579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 543/1079] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.083130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.093846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c657e0d-d98a-4503-8a4c-8e2172c780f3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.098522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.099287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.099566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.099835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.110490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.112295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.129048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:44.130239 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 537/1080] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:44.137014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.146683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496482f3-4647-42b0-bf7b-3f9fc852076f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.151279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.151920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.152198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.152469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.153192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.153493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.155095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.167408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 544/1081] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.173918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.183060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e956a03-3b85-41ba-bda8-f9b27f74bdd3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.189456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.190253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.190531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.190799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.197905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.199918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.213819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 15 12:52:44.223487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 538/1082] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:44.225168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.235819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d0787-a7f5-412c-a346-0a2d270852a9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.240691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.241347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.241628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.241902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.242782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.243088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.245091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.262425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 545/1083] 10.222.0.57 () {56 vars in 1154 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.270381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.279892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155ff8-c31f-495b-88b5-deba221d8d4a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.285339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.285947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.286252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.286524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.293925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.295672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.304874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 539/1084] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:44.311098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.321221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917afe46-fc1f-4f59-a85a-9b43737254f9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.325809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.326665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.326947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.327242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.338496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.340370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.358093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:52:44.359923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 546/1085] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:44.366203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.375145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22104-90e8-4ce1-a666-4257866fc815 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.379723 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.380418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.380704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.380979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.381715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.382023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.383667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.394717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 540/1086] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.400723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.411430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b28d6-5bf4-40d1-bc92-282efc84da0c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.416856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.417828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.417952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.418997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.431047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.433165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.446993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:52:44.448221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 547/1087] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:44.454788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.464570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfad531-b676-4a58-97bf-15e6eda830d0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.469835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.470522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.470808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.471083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.471883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.472186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.474024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50b60c-bbcd-4dbc-9938-17702c3f23ae admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.487242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 541/1088] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.494503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.507093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726271af-0553-45c8-a60a-8cdf64a88495 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.511588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.512221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.512500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.512770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.513607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] RBAC: Adding query filter params (role.id=223d3a98917a457aa1ef0641be5e5c4e, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=6b2623b20f16432d986a95fc400d52b6) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.513910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.515829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5eace3-00f1-493e-8e42-fb265f0cccd1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.521821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 548/1089] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/role_assignments?user.id=6b2623b20f16432d986a95fc400d52b6&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=223d3a98917a457aa1ef0641be5e5c4e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.726638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13defac6-1ad4-4710-b1fe-72b13dfe0700 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.726924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13defac6-1ad4-4710-b1fe-72b13dfe0700 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.727198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13defac6-1ad4-4710-b1fe-72b13dfe0700 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.728971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 542/1090] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:44.735687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.736049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.736401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.754260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:44.755434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:44.763308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 549/1091] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:52:44.786647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13defac6-1ad4-4710-b1fe-72b13dfe0700 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.799794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13defac6-1ad4-4710-b1fe-72b13dfe0700 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.805193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.805945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.806264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.806543 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.819678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:44.826528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:44.827767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 543/1092] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:44.834556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.843833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8657-b1e1-4b04-b191-d68e4f0a737c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.848612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.849291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.849576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.849855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.850653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:44.850958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.852562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.861940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 550/1093] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.868806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.879801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f80954-7b21-4bec-ba7b-8e7288a138ab admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.884443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.885300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.885581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.885854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] PATH_INFO: `/v3/users/08d04eb7b0ed42c3858c523b05ab1a8d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.887128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] RBAC: Authorizing `identity:get_user(user_id=08d04eb7b0ed42c3858c523b05ab1a8d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.889243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.890923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 544/1094] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/users/08d04eb7b0ed42c3858c523b05ab1a8d => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:44.897502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.908500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcc7a5-d79b-4d75-9c7b-ac0bc0c8f893 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.913644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd093f9-0ba3-41de-b7db-cace05093896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.914592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd093f9-0ba3-41de-b7db-cace05093896 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.914874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd093f9-0ba3-41de-b7db-cace05093896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.915147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd093f9-0ba3-41de-b7db-cace05093896 admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.916401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd093f9-0ba3-41de-b7db-cace05093896 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d6c5d7e8a0b42a69fa8fe027598d177)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.918504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd093f9-0ba3-41de-b7db-cace05093896 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.920208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 551/1095] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:52:44 2021] GET /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:44.927467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:44.937256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd7b10-0fa8-47b7-842c-7a384c71165c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:44.941972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454fb0c-fe05-4856-9566-1bef8d49e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:44.942898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454fb0c-fe05-4856-9566-1bef8d49e8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:44.943177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454fb0c-fe05-4856-9566-1bef8d49e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:44.943449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454fb0c-fe05-4856-9566-1bef8d49e8fd admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177/users/08d04eb7b0ed42c3858c523b05ab1a8d/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:44.945444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454fb0c-fe05-4856-9566-1bef8d49e8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6c5d7e8a0b42a69fa8fe027598d177, user_id=08d04eb7b0ed42c3858c523b05ab1a8d, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:44.948117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454fb0c-fe05-4856-9566-1bef8d49e8fd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:44.963962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 545/1096] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:44 2021] PUT /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177/users/08d04eb7b0ed42c3858c523b05ab1a8d/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:52:47.335289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fd47d-5623-4743-9073-35c0e37cfb71 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.335850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fd47d-5623-4743-9073-35c0e37cfb71 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.335850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fd47d-5623-4743-9073-35c0e37cfb71 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.337588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 552/1097] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:47.343733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.344152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.344258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.361899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:47.363099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:47.417412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 546/1098] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:47.441772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fd47d-5623-4743-9073-35c0e37cfb71 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:47.453713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fd47d-5623-4743-9073-35c0e37cfb71 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:47.458269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:47.459039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.459313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.459577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.470431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:52:47.477034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:52:47.478354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 553/1099] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:52:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:52:47.484850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:47.493687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaeadc-c919-4bee-b1d2-a73d50e8ac52 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:47.498119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:47.498781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.499057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.499322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.500068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:47.500366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:47.501932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:47.509675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 547/1100] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:52:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:47.515507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:47.524717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d18e11-d943-4685-a15f-f87782f8179f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:47.529117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:47.529928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.531810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.532084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] PATH_INFO: `/v3/users/08d04eb7b0ed42c3858c523b05ab1a8d` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.533280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] RBAC: Authorizing `identity:get_user(user_id=08d04eb7b0ed42c3858c523b05ab1a8d)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:47.535678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:47.537195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 554/1101] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:47 2021] GET /identity/v3/users/08d04eb7b0ed42c3858c523b05ab1a8d => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:47.542832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:47.552457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dea524-7e99-4a45-b049-2737e08cbcd7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:47.556840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:47.557443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.557720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.557988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.565377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:47.567103 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:47.575511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 548/1102] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:47 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:47.581760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:47.591093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069555aa-15e9-402e-ac11-9c86f72ae41c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:47.595569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb37b8-1735-4dbd-88d3-ce7def38181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:47.596385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb37b8-1735-4dbd-88d3-ce7def38181e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.596668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb37b8-1735-4dbd-88d3-ce7def38181e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.596941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb37b8-1735-4dbd-88d3-ce7def38181e admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.598109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb37b8-1735-4dbd-88d3-ce7def38181e admin admin] RBAC: Authorizing `identity:get_project(project_id=3d6c5d7e8a0b42a69fa8fe027598d177)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:47.600111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb37b8-1735-4dbd-88d3-ce7def38181e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:47.601811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 555/1103] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:52:47 2021] GET /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:47.607471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:47.616210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df23d28-bc59-4cd7-8f20-efea23124556 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:47.620741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:47.621341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:47.621621 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:47.621896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:47.622753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177, user.id=08d04eb7b0ed42c3858c523b05ab1a8d) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:47.623071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:47.625431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b0a8-4bfd-4e52-af13-042e527c7c0c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:47.630914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 549/1104] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:47 2021] GET /identity/v3/role_assignments?user.id=08d04eb7b0ed42c3858c523b05ab1a8d&scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:49.989178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944548fb-7049-4e0a-85ae-1666aa710934 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:49.989734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944548fb-7049-4e0a-85ae-1666aa710934 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:49.989734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944548fb-7049-4e0a-85ae-1666aa710934 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:49.991518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 556/1105] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:49.997114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:49.997524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:49.997674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:50.015185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:50.016358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:50.023945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 550/1106] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:50.049524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944548fb-7049-4e0a-85ae-1666aa710934 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:50.061457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944548fb-7049-4e0a-85ae-1666aa710934 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:50.065804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39816fd-d73a-4b61-bec7-46804345af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:50.066538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39816fd-d73a-4b61-bec7-46804345af33 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:50.066818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39816fd-d73a-4b61-bec7-46804345af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:50.067091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39816fd-d73a-4b61-bec7-46804345af33 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:50.068259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39816fd-d73a-4b61-bec7-46804345af33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:50.069918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39816fd-d73a-4b61-bec7-46804345af33 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:50.071459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 557/1107] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:52:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:50.077698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:50.086291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bac3d-ca16-4cfe-959f-919b70905a6f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:50.090709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267cf94-b82d-48a2-8437-36b6e4838a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:50.091344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cf94-b82d-48a2-8437-36b6e4838a58 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:50.091620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cf94-b82d-48a2-8437-36b6e4838a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:50.091888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cf94-b82d-48a2-8437-36b6e4838a58 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:50.093210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267cf94-b82d-48a2-8437-36b6e4838a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:50.095134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267cf94-b82d-48a2-8437-36b6e4838a58 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:50.113609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 551/1108] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:52:50 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:52:52.456732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e2a1-28a9-4d1b-aa65-8e196ef543f4 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.457288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e2a1-28a9-4d1b-aa65-8e196ef543f4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.457288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e2a1-28a9-4d1b-aa65-8e196ef543f4 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.459058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 558/1109] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:52.464712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.465136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.465297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.483530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:52.484726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:52.492307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 552/1110] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:52 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:52.516130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e2a1-28a9-4d1b-aa65-8e196ef543f4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:52.527931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e2a1-28a9-4d1b-aa65-8e196ef543f4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:52.532714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:52.533526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.533805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.534071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] PATH_INFO: `/v3/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.535816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] RBAC: Authorizing `identity:get_role(role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:52.536814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:52.536814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:52:52.536814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:52:52.537680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:52.538982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 559/1111] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:52 2021] GET /identity/v3/roles/fc97b407668046f9b05b539f70740d3d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:52.544690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:52.553920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e228ab7-2dab-479e-a450-4c9eec8a688b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:52.558399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:52.559240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.559521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.559796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] PATH_INFO: `/v3/users/ed22f83fb67d499e9bea64c9d02dfcd1` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.573027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed22f83fb67d499e9bea64c9d02dfcd1)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:52.575196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:52.576819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 553/1112] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:52 2021] GET /identity/v3/users/ed22f83fb67d499e9bea64c9d02dfcd1 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:52.582621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:52.591911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5c97b-6dde-4da3-b2ee-2f3b0dccb017 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:52.596873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:52.597474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.597751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.598020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.605444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:52.607193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:52.616273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 560/1113] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:52 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:52.622000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:52.631520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b4e4-3dc4-465f-92a4-63e5ce2697b7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:52.636031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6606bd-eacf-4047-a1be-282d3001fab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:52.636834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6606bd-eacf-4047-a1be-282d3001fab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.637109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6606bd-eacf-4047-a1be-282d3001fab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.637379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6606bd-eacf-4047-a1be-282d3001fab9 admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.638553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6606bd-eacf-4047-a1be-282d3001fab9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d6c5d7e8a0b42a69fa8fe027598d177)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:52.640521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6606bd-eacf-4047-a1be-282d3001fab9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:52.642098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 554/1114] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:52:52 2021] GET /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:52:52.648020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:52.656874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9262f3-e7c7-42ea-8514-8b1414013ec2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:52.661632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:52.662255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:52.662537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:52.662805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:52.663617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] RBAC: Adding query filter params (role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177, user.id=ed22f83fb67d499e9bea64c9d02dfcd1) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:52.663918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:52.665691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb533e-598b-4295-b57d-031cb1e0b01a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:52.671381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 561/1115] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:52 2021] GET /identity/v3/role_assignments?user.id=ed22f83fb67d499e9bea64c9d02dfcd1&scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177&role.id=fc97b407668046f9b05b539f70740d3d => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:55.031109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42155a9d-c93d-4a7b-b84d-a82ec2a41670 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:55.031649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42155a9d-c93d-4a7b-b84d-a82ec2a41670 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:55.031904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42155a9d-c93d-4a7b-b84d-a82ec2a41670 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:55.033702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 555/1116] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:55.039966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c674959-2466-472d-844e-9e578cca799e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:55.040410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c674959-2466-472d-844e-9e578cca799e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:55.040578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c674959-2466-472d-844e-9e578cca799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:55.058310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0c674959-2466-472d-844e-9e578cca799e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:55.059476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0c674959-2466-472d-844e-9e578cca799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:55.067010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 562/1117] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:55.090166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42155a9d-c93d-4a7b-b84d-a82ec2a41670 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:55.102449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42155a9d-c93d-4a7b-b84d-a82ec2a41670 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:55.106704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:55.107513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:55.107790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:55.108059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] PATH_INFO: `/v3/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:55.109514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] RBAC: Authorizing `identity:get_role(role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:55.110544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:52:55.110544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 12:52:55.110544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 12:52:55.111404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:55.112685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 556/1118] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:55 2021] GET /identity/v3/roles/fc97b407668046f9b05b539f70740d3d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:55.118502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c674959-2466-472d-844e-9e578cca799e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:55.127016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c674959-2466-472d-844e-9e578cca799e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:55.131429 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:55.132252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:55.132531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:55.132804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] PATH_INFO: `/v3/users/ed22f83fb67d499e9bea64c9d02dfcd1` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:55.133989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed22f83fb67d499e9bea64c9d02dfcd1)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:55.136104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:55.137614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 563/1119] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:55 2021] GET /identity/v3/users/ed22f83fb67d499e9bea64c9d02dfcd1 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:55.143814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:55.152799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373b683-12d7-4393-a864-8820c6b5ef33 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:55.157246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b84e8-eb09-479d-a6d4-ab2313a88af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:55.158029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b84e8-eb09-479d-a6d4-ab2313a88af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:55.158336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b84e8-eb09-479d-a6d4-ab2313a88af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:55.158603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b84e8-eb09-479d-a6d4-ab2313a88af4 admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:55.160006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b84e8-eb09-479d-a6d4-ab2313a88af4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d6c5d7e8a0b42a69fa8fe027598d177)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:55.161962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b84e8-eb09-479d-a6d4-ab2313a88af4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:55.163571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 557/1120] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:52:55 2021] GET /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:55.169318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:55.178905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f544b5e-1bc6-4a60-a5e4-678407ff5610 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:55.183327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a3d48-cd2e-4318-8763-447ce64d1843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:55.184135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3d48-cd2e-4318-8763-447ce64d1843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:55.184411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3d48-cd2e-4318-8763-447ce64d1843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:55.184679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a3d48-cd2e-4318-8763-447ce64d1843 admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177/users/ed22f83fb67d499e9bea64c9d02dfcd1/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:55.186931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a3d48-cd2e-4318-8763-447ce64d1843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6c5d7e8a0b42a69fa8fe027598d177, user_id=ed22f83fb67d499e9bea64c9d02dfcd1, role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:55.189479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a3d48-cd2e-4318-8763-447ce64d1843 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:55.202312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 564/1121] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:52:55 2021] PUT /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177/users/ed22f83fb67d499e9bea64c9d02dfcd1/roles/fc97b407668046f9b05b539f70740d3d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:52:57.548141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864da2a-8628-45df-855d-72d5ac543a6d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.548669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864da2a-8628-45df-855d-72d5ac543a6d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.548669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864da2a-8628-45df-855d-72d5ac543a6d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.550459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 558/1122] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:52:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:52:57.556169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.556559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.556714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.574089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:52:57.575334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:52:57.630449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 565/1123] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:52:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:52:57.655809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864da2a-8628-45df-855d-72d5ac543a6d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:57.667832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864da2a-8628-45df-855d-72d5ac543a6d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:57.672140 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:57.672953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.673227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.673493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] PATH_INFO: `/v3/roles/fc97b407668046f9b05b539f70740d3d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.674981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] RBAC: Authorizing `identity:get_role(role_id=fc97b407668046f9b05b539f70740d3d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:57.676546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:57.677822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 559/1124] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:57 2021] GET /identity/v3/roles/fc97b407668046f9b05b539f70740d3d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:57.683800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:57.693104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e8afb-8491-4e65-a0c4-c614b07480a4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:57.697597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:57.698459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.698741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.699015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] PATH_INFO: `/v3/users/ed22f83fb67d499e9bea64c9d02dfcd1` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.700215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] RBAC: Authorizing `identity:get_user(user_id=ed22f83fb67d499e9bea64c9d02dfcd1)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:57.702957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:57.704488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 566/1125] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:52:57 2021] GET /identity/v3/users/ed22f83fb67d499e9bea64c9d02dfcd1 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:57.710194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:57.719092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce43b-60c5-4b63-99f4-6e68cb391df6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:57.723433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:57.724012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.724287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.724705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.732474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:57.734171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:57.742632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 560/1126] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:52:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:52:57.749464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:57.758687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f67698-c68b-4fcd-8600-4170d0ba543a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:57.767008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1c9db-19b5-4f9e-8751-07f0d3ab7632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:57.767859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c9db-19b5-4f9e-8751-07f0d3ab7632 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.768140 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c9db-19b5-4f9e-8751-07f0d3ab7632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.768406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c9db-19b5-4f9e-8751-07f0d3ab7632 admin admin] PATH_INFO: `/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.769582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1c9db-19b5-4f9e-8751-07f0d3ab7632 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d6c5d7e8a0b42a69fa8fe027598d177)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:57.771650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1c9db-19b5-4f9e-8751-07f0d3ab7632 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:57.773308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 567/1127] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:52:57 2021] GET /identity/v3/projects/3d6c5d7e8a0b42a69fa8fe027598d177 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:52:57.780093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:52:57.789220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcc60d-38f2-46c0-85d2-f8af2fe1e1e4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:52:57.793656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:52:57.794316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:52:57.794600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:52:57.794874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:52:57.795707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] RBAC: Adding query filter params (role.id=fc97b407668046f9b05b539f70740d3d, scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177, user.id=ed22f83fb67d499e9bea64c9d02dfcd1) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:52:57.796015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:52:57.797829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b927c-30f9-4d45-8b80-989b1604fd8b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:52:57.803520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 561/1128] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:52:57 2021] GET /identity/v3/role_assignments?user.id=ed22f83fb67d499e9bea64c9d02dfcd1&scope.project.id=3d6c5d7e8a0b42a69fa8fe027598d177&role.id=fc97b407668046f9b05b539f70740d3d => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:00.117605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616965e9-b7d3-445b-80d5-2c637e4505e3 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:00.118125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616965e9-b7d3-445b-80d5-2c637e4505e3 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:00.118125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616965e9-b7d3-445b-80d5-2c637e4505e3 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:00.119827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 568/1129] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:00.126218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:00.126636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:00.126767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:00.145083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:00.146279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:00.153734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 562/1130] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:53:00.177617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616965e9-b7d3-445b-80d5-2c637e4505e3 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:00.190127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616965e9-b7d3-445b-80d5-2c637e4505e3 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:00.194408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a40f7-7548-421d-9004-ae321c13122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:00.195160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a40f7-7548-421d-9004-ae321c13122f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:00.195435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a40f7-7548-421d-9004-ae321c13122f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:00.195705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a40f7-7548-421d-9004-ae321c13122f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:00.196886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a40f7-7548-421d-9004-ae321c13122f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:00.198588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a40f7-7548-421d-9004-ae321c13122f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:00.200120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 569/1131] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:53:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:00.206640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:00.215174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258e5c9-fe28-4d16-a9ee-b7a8095520f0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:00.219592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2f7c9-6ffe-444e-9e53-1d14b31c95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:00.220221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2f7c9-6ffe-444e-9e53-1d14b31c95a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:00.220497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2f7c9-6ffe-444e-9e53-1d14b31c95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:00.220766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2f7c9-6ffe-444e-9e53-1d14b31c95a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:00.221483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2f7c9-6ffe-444e-9e53-1d14b31c95a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:00.223366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2f7c9-6ffe-444e-9e53-1d14b31c95a0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:00.246641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 563/1132] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:53:00 2021] POST /identity/v3/projects => generated 311 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:53:02.588907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8252ae-7798-4c00-9313-5eb4208d0912 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:02.589501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8252ae-7798-4c00-9313-5eb4208d0912 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:02.589501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8252ae-7798-4c00-9313-5eb4208d0912 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:02.591236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 570/1133] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:02.597113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:02.597544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:02.597653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:02.615276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:02.616441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:02.669614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 564/1134] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:02.694867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8252ae-7798-4c00-9313-5eb4208d0912 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:02.707177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8252ae-7798-4c00-9313-5eb4208d0912 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:02.711454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a048b-64c4-40f8-b44b-308ae584adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:02.712204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a048b-64c4-40f8-b44b-308ae584adb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:02.712479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a048b-64c4-40f8-b44b-308ae584adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:02.712746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a048b-64c4-40f8-b44b-308ae584adb6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:02.713909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a048b-64c4-40f8-b44b-308ae584adb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:02.715603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a048b-64c4-40f8-b44b-308ae584adb6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:02.717753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 571/1135] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:53:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:53:02.723530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:02.732117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e830a0-802b-47e2-bd9f-bd40d48ba758 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:02.736617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a88a2-6fc5-4897-8285-775a6c56a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:02.737259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a88a2-6fc5-4897-8285-775a6c56a790 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:02.737540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a88a2-6fc5-4897-8285-775a6c56a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:02.737814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a88a2-6fc5-4897-8285-775a6c56a790 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:02.738580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a88a2-6fc5-4897-8285-775a6c56a790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:02.740461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a88a2-6fc5-4897-8285-775a6c56a790 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:02.759662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 565/1136] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:53:02 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:53:05.180462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351b7b3-9b1c-410c-a057-5f94fc62a08e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.181010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351b7b3-9b1c-410c-a057-5f94fc62a08e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.181010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351b7b3-9b1c-410c-a057-5f94fc62a08e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.182831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 572/1137] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:05.188792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.189220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.189407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.206450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:05.207632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:05.215165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 566/1138] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:05.239902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351b7b3-9b1c-410c-a057-5f94fc62a08e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:05.251561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351b7b3-9b1c-410c-a057-5f94fc62a08e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:05.255785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:05.256532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.256808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.257076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.266818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:53:05.273453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:53:05.274606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 573/1139] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:53:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:05.281119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:05.290007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd556c8-2859-48d1-86c8-05373ab7bf05 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:05.294459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:05.295697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.295976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.296249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.297008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:05.297311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:05.298922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:05.306871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 567/1140] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:53:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:05.312865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:05.323989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d100f33-573b-4e26-8082-d05cc0032d49 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:05.328560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:05.329402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.329683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.329951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] PATH_INFO: `/v3/users/3a2c1cedb7b54b53a639f6b62bd7ae23` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.345734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a2c1cedb7b54b53a639f6b62bd7ae23)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:05.349144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:05.351762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 574/1141] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:53:05 2021] GET /identity/v3/users/3a2c1cedb7b54b53a639f6b62bd7ae23 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:05.358799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:05.368285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5f417-8e37-4d15-b952-bb766b429b88 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:05.372683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:05.373303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.373578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.373848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.381247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:05.383001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:05.391473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 568/1142] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:53:05 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:53:05.397582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:05.407612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568503c2-c010-4bfc-a40a-708748414050 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:05.412316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8f49b-f41f-492b-a37b-25b7557fdd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:05.413134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8f49b-f41f-492b-a37b-25b7557fdd4a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.413413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8f49b-f41f-492b-a37b-25b7557fdd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.413683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8f49b-f41f-492b-a37b-25b7557fdd4a admin admin] PATH_INFO: `/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.414843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8f49b-f41f-492b-a37b-25b7557fdd4a admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbdcc4c6a314b1abdf4e38f0066540f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:05.416842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8f49b-f41f-492b-a37b-25b7557fdd4a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:05.418475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 575/1143] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:53:05 2021] GET /identity/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:05.425321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:05.433774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacd61-e8ee-4812-9e7f-869ce61bf7c3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:05.438655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:05.439260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:05.439537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:05.439806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:05.440623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=3dbdcc4c6a314b1abdf4e38f0066540f, user.id=3a2c1cedb7b54b53a639f6b62bd7ae23) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:05.440926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:05.442733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544b58-2ac8-4919-acfa-3a85b27de2a7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:05.447855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 569/1144] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:53:05 2021] GET /identity/v3/role_assignments?user.id=3a2c1cedb7b54b53a639f6b62bd7ae23&scope.project.id=3dbdcc4c6a314b1abdf4e38f0066540f&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:07.762044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5973ee-0a78-4ad9-b232-b2992810a7dc None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.762664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5973ee-0a78-4ad9-b232-b2992810a7dc None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.762664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5973ee-0a78-4ad9-b232-b2992810a7dc None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.764402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 576/1145] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:07.770241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.770654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.770788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.788472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:07.789633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:07.797735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 570/1146] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:07.820614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5973ee-0a78-4ad9-b232-b2992810a7dc None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:07.833079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5973ee-0a78-4ad9-b232-b2992810a7dc None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:07.837344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:07.838109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.838422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.838692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.849171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:53:07.855935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:53:07.857085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 577/1147] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:53:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:07.863255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:07.871810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26349d0-0993-4c20-9e36-7c8c33450d96 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:07.876169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:07.876807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.877082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.877351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.878101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:07.878434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:07.879991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:07.887798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 571/1148] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:53:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:07.894203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:07.904507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18556ce3-8f0d-4e16-a562-7cb58502360b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:07.909254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:07.910050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.910350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.910622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] PATH_INFO: `/v3/users/3a2c1cedb7b54b53a639f6b62bd7ae23` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.911807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a2c1cedb7b54b53a639f6b62bd7ae23)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:07.913895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:07.915445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 578/1149] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:53:07 2021] GET /identity/v3/users/3a2c1cedb7b54b53a639f6b62bd7ae23 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:07.921054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:07.930050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40019-4192-40ee-bba4-fa35b3064781 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:07.934420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237d7f-54f1-464e-9d59-27a21d7ece76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:07.935216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237d7f-54f1-464e-9d59-27a21d7ece76 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.935493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237d7f-54f1-464e-9d59-27a21d7ece76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.935761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237d7f-54f1-464e-9d59-27a21d7ece76 admin admin] PATH_INFO: `/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.936913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237d7f-54f1-464e-9d59-27a21d7ece76 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbdcc4c6a314b1abdf4e38f0066540f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:07.938900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237d7f-54f1-464e-9d59-27a21d7ece76 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:07.940581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 572/1150] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:53:07 2021] GET /identity/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:07.946110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:07.955730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d7402-31f2-4071-9d91-32c5c62e50b5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:07.960169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e3b6-4b8d-488a-a610-14656e681f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:07.960980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e3b6-4b8d-488a-a610-14656e681f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:07.961257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e3b6-4b8d-488a-a610-14656e681f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:07.961527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e3b6-4b8d-488a-a610-14656e681f21 admin admin] PATH_INFO: `/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f/users/3a2c1cedb7b54b53a639f6b62bd7ae23/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:07.963472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e3b6-4b8d-488a-a610-14656e681f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbdcc4c6a314b1abdf4e38f0066540f, user_id=3a2c1cedb7b54b53a639f6b62bd7ae23, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:07.966038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e3b6-4b8d-488a-a610-14656e681f21 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:07.979351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 579/1151] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:53:07 2021] PUT /identity/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f/users/3a2c1cedb7b54b53a639f6b62bd7ae23/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:53:10.280016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e909-74c1-4480-b618-e19eb0d0f975 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.280589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e909-74c1-4480-b618-e19eb0d0f975 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.280589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5e909-74c1-4480-b618-e19eb0d0f975 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.282450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 573/1152] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:10.288265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.288690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.288818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.306507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:10.307683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:10.362837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 580/1153] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:10.386308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5e909-74c1-4480-b618-e19eb0d0f975 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:10.398803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5e909-74c1-4480-b618-e19eb0d0f975 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:10.403180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:10.404551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.404852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.405124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.415386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:53:10.422570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:53:10.423700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 574/1154] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:53:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:10.429786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:10.439023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e07a-8f8b-4709-8f35-306cfb28027a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:10.443497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:10.444132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.444412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.444685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.445432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:10.445734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:10.447349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:10.455891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 581/1155] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:53:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:10.461656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:10.471410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862d6c7-2c0a-47cf-8c2d-74f21a3bb39a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:10.476013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:10.476840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.477148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.477447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] PATH_INFO: `/v3/users/3a2c1cedb7b54b53a639f6b62bd7ae23` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.478683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a2c1cedb7b54b53a639f6b62bd7ae23)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:10.480777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:10.482459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 575/1156] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:53:10 2021] GET /identity/v3/users/3a2c1cedb7b54b53a639f6b62bd7ae23 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:10.487925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:10.496931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965703a-6b58-43de-8de5-ff0b324053ee admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:10.501981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:10.502611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.502894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.503168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.510657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:10.512693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:10.521867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 582/1157] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:53:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:53:10.527774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:10.537487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0291a5-e751-4e12-9d7e-932530dcad26 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:10.542068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5ce27-4d5b-4b71-b26d-ee196097f974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:10.542889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5ce27-4d5b-4b71-b26d-ee196097f974 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.543170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5ce27-4d5b-4b71-b26d-ee196097f974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.543442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5ce27-4d5b-4b71-b26d-ee196097f974 admin admin] PATH_INFO: `/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.544603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5ce27-4d5b-4b71-b26d-ee196097f974 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbdcc4c6a314b1abdf4e38f0066540f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:10.546727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5ce27-4d5b-4b71-b26d-ee196097f974 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:10.548319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 576/1158] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:53:10 2021] GET /identity/v3/projects/3dbdcc4c6a314b1abdf4e38f0066540f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:10.554197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:10.562926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d1bb4-b301-4a88-8bb3-8202f4f9c9bf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:10.567422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:10.568015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:10.568297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:10.568569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:10.569478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=3dbdcc4c6a314b1abdf4e38f0066540f, user.id=3a2c1cedb7b54b53a639f6b62bd7ae23) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:10.569789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:10.571603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18988b27-f359-4faf-b2a9-3834ea6cbb4f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:10.577628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 583/1159] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:53:10 2021] GET /identity/v3/role_assignments?user.id=3a2c1cedb7b54b53a639f6b62bd7ae23&scope.project.id=3dbdcc4c6a314b1abdf4e38f0066540f&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:53:12.896449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e49be-6973-4460-b1c7-0861e3285f89 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:12.896960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e49be-6973-4460-b1c7-0861e3285f89 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:12.896960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e49be-6973-4460-b1c7-0861e3285f89 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:12.898876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 577/1160] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:12.904840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:12.905262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:12.905487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:12.922889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:12.924051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:12.931504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 584/1161] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:53:12.954895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e49be-6973-4460-b1c7-0861e3285f89 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:12.966642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e49be-6973-4460-b1c7-0861e3285f89 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:12.971057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:12.971665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:12.971943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:12.972211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:12.979601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:12.981324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:12.989784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 578/1162] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:53:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:53:12.995780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:13.004981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbd563-7b90-4217-9ccb-d1561528361f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:13.009526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:13.010335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:13.010619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:13.010891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:13.018234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:13.020033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:13.034804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-e3db0770-4333-4747-8494-fc9c8158aba6 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 15 12:53:13.035930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 585/1163] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:53:12 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:13.041827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:13.050870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271edfc-ec61-4d9d-80c2-87d470ebeb07 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:13.055320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:13.055940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:13.056218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:13.056490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:13.057214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:13.057516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:13.059083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed039f9-8ad8-4217-82f2-48966cc0cc54 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:13.066714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 579/1164] 10.222.0.57 () {56 vars in 1136 bytes} [Wed Dec 15 12:53:13 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:15.421703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46fd5f-da60-45e7-89d3-f73d257f4d22 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:15.422354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46fd5f-da60-45e7-89d3-f73d257f4d22 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:15.422354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46fd5f-da60-45e7-89d3-f73d257f4d22 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:15.424031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 586/1165] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:15.429664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b072-453c-4580-ba0d-f39ecca9198a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:15.430083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b072-453c-4580-ba0d-f39ecca9198a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:15.430221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b072-453c-4580-ba0d-f39ecca9198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:15.447802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-fc88b072-453c-4580-ba0d-f39ecca9198a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:15.448960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fc88b072-453c-4580-ba0d-f39ecca9198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:15.457046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 580/1166] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:15.479945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46fd5f-da60-45e7-89d3-f73d257f4d22 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:15.492289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46fd5f-da60-45e7-89d3-f73d257f4d22 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:15.496698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:15.497917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:15.498243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:15.498519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:15.499263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:15.500261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 12:53:15.500261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 12:53:15.500261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 12:53:15.501116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72a747-c47c-45bd-90c4-e5e2933671fd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:15.515119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 587/1167] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Dec 15 12:53:15 2021] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:53:17.884193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2a57-3f5f-4fd3-8ae7-f2b676ec60ce None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:17.884699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2a57-3f5f-4fd3-8ae7-f2b676ec60ce None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:17.884798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2a57-3f5f-4fd3-8ae7-f2b676ec60ce None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:17.886526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 581/1168] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:17.892264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:17.892703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:17.892801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:17.910774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:17.911943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:17.965120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 588/1169] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:17.989802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc2a57-3f5f-4fd3-8ae7-f2b676ec60ce None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:18.002730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc2a57-3f5f-4fd3-8ae7-f2b676ec60ce None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:18.007075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d284c3f-08be-45dd-8e11-ca3ec44f7bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:18.007931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284c3f-08be-45dd-8e11-ca3ec44f7bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:18.008233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284c3f-08be-45dd-8e11-ca3ec44f7bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:18.008509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284c3f-08be-45dd-8e11-ca3ec44f7bbd admin admin] PATH_INFO: `/v3/domains/40064f48e8f54368b2ee79d521bec05f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:18.019416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d284c3f-08be-45dd-8e11-ca3ec44f7bbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=40064f48e8f54368b2ee79d521bec05f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:18.021364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d284c3f-08be-45dd-8e11-ca3ec44f7bbd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:18.023002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 582/1170] 10.222.0.57 () {56 vars in 1204 bytes} [Wed Dec 15 12:53:17 2021] GET /identity/v3/domains/40064f48e8f54368b2ee79d521bec05f => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:18.028983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:18.037858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f3f2e-3483-414f-bb1e-31a250fde0e0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:18.042341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028db4-733a-4ce7-a74a-42d8094cd9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:18.042967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028db4-733a-4ce7-a74a-42d8094cd9cd admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:18.043241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028db4-733a-4ce7-a74a-42d8094cd9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:18.043508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028db4-733a-4ce7-a74a-42d8094cd9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:18.044209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028db4-733a-4ce7-a74a-42d8094cd9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:18.046200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028db4-733a-4ce7-a74a-42d8094cd9cd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:18.074355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 589/1171] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:53:18 2021] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:53:20.400479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51ea7-1b7d-4252-a8eb-ba97e8f664df None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:20.401005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51ea7-1b7d-4252-a8eb-ba97e8f664df None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:20.401121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51ea7-1b7d-4252-a8eb-ba97e8f664df None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:20.403509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 583/1172] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:20.409563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:20.409958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:20.410106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:20.427876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:20.429038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:20.482962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 590/1173] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:20.508764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa51ea7-1b7d-4252-a8eb-ba97e8f664df None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:20.520864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa51ea7-1b7d-4252-a8eb-ba97e8f664df None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:20.525163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97f9ea-ae3e-4c99-a279-12c24c5b4fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:20.525993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97f9ea-ae3e-4c99-a279-12c24c5b4fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:20.526312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97f9ea-ae3e-4c99-a279-12c24c5b4fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:20.526588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97f9ea-ae3e-4c99-a279-12c24c5b4fb8 admin admin] PATH_INFO: `/v3/domains/40064f48e8f54368b2ee79d521bec05f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:20.527775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97f9ea-ae3e-4c99-a279-12c24c5b4fb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=40064f48e8f54368b2ee79d521bec05f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:20.530344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97f9ea-ae3e-4c99-a279-12c24c5b4fb8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:20.531899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 584/1174] 10.222.0.57 () {56 vars in 1204 bytes} [Wed Dec 15 12:53:20 2021] GET /identity/v3/domains/40064f48e8f54368b2ee79d521bec05f => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:20.537860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:20.547051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7c632-e0da-4500-abd9-fe126b16b358 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:20.551450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f3b89-eb08-410f-860b-cbd9addb3a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:20.552079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3b89-eb08-410f-860b-cbd9addb3a63 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:20.552354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3b89-eb08-410f-860b-cbd9addb3a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:20.552622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3b89-eb08-410f-860b-cbd9addb3a63 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:20.553329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f3b89-eb08-410f-860b-cbd9addb3a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:20.555248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f3b89-eb08-410f-860b-cbd9addb3a63 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:20.575414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 591/1175] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:53:20 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:53:22.924717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c48a-52ce-414a-8be7-1b4ee98d0374 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:22.925251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c48a-52ce-414a-8be7-1b4ee98d0374 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:22.925251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c48a-52ce-414a-8be7-1b4ee98d0374 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:22.927088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 585/1176] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:22.932789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:22.933310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:22.933310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:22.951050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:22.952201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:22.959616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 592/1177] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:53:22.984021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c48a-52ce-414a-8be7-1b4ee98d0374 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:22.996108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c48a-52ce-414a-8be7-1b4ee98d0374 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:23.000647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:23.002045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:23.002799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:23.003075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:23.020420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:53:23.027241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:53:23.029062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 586/1178] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:53:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:23.035727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:23.044468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb3900-6da8-435c-99ed-582d71126d70 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:23.048860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:23.049498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:23.049773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:23.050041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:23.050818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:23.051116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:23.052683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:23.060513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 593/1179] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:53:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:23.066389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:23.076040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9c0bb-8f6c-469f-a565-8e7724555e93 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:23.080454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:23.081276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:23.081554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:23.081820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] PATH_INFO: `/v3/users/edf8721434614a50a5e855659acecd06` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:23.095262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] RBAC: Authorizing `identity:get_user(user_id=edf8721434614a50a5e855659acecd06)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:23.097360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:23.098957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 587/1180] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:53:23 2021] GET /identity/v3/users/edf8721434614a50a5e855659acecd06 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:23.104911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:23.114122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e86f-b6aa-45dc-aa72-a34b77bd354a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:23.118550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:23.119154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:23.119432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:23.119701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:23.127154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:23.128938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:23.137935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 594/1181] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:53:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:53:23.143617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:23.152782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8888-586c-4275-aab5-14d8c6c8f68d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:23.157959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de64a6-025d-4c2e-8c8d-5cb341cd6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:23.159071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de64a6-025d-4c2e-8c8d-5cb341cd6393 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:23.159353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de64a6-025d-4c2e-8c8d-5cb341cd6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:23.159626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de64a6-025d-4c2e-8c8d-5cb341cd6393 admin admin] PATH_INFO: `/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:23.160828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de64a6-025d-4c2e-8c8d-5cb341cd6393 admin admin] RBAC: Authorizing `identity:get_project(project_id=6ac3f1468bb24c21b6ce54b52bb880b6)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:23.162849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de64a6-025d-4c2e-8c8d-5cb341cd6393 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:23.164560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 588/1182] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:53:23 2021] GET /identity/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:23.170223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:23.178447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7eacfc-0526-4575-ae99-0547ff319664 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:23.182986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:23.183618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:23.184499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:23.184865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:23.186021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=6ac3f1468bb24c21b6ce54b52bb880b6, user.id=edf8721434614a50a5e855659acecd06) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:23.186366 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:23.188141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794266c2-b0fc-47b7-8b5a-2c4394ec2f7c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:23.193307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 595/1183] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:53:23 2021] GET /identity/v3/role_assignments?user.id=edf8721434614a50a5e855659acecd06&scope.project.id=6ac3f1468bb24c21b6ce54b52bb880b6&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:53:25.512712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb89b1-f03d-4313-86c4-f56a62360a06 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.513240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb89b1-f03d-4313-86c4-f56a62360a06 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.513240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb89b1-f03d-4313-86c4-f56a62360a06 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.515041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 589/1184] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:25.520835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.521251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.521374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.539238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:25.540400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:25.548496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 596/1185] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:25.571198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb89b1-f03d-4313-86c4-f56a62360a06 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:25.583034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb89b1-f03d-4313-86c4-f56a62360a06 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:25.587372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:25.588123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.588402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.588673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.598995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:53:25.606375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:53:25.607500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 590/1186] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:53:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:25.613470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:25.622039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd7fc3-73bc-47af-b31a-2136b416ac50 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:25.626457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:25.627084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.627359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.627625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.628362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:25.628658 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:25.630267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:25.638091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 597/1187] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:53:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:25.643843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:25.653977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aa19b-da12-4b43-900f-f400e2ea97f0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:25.658745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:25.659543 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.659818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.660083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] PATH_INFO: `/v3/users/edf8721434614a50a5e855659acecd06` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.661268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] RBAC: Authorizing `identity:get_user(user_id=edf8721434614a50a5e855659acecd06)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:25.663386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:25.664919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 591/1188] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:53:25 2021] GET /identity/v3/users/edf8721434614a50a5e855659acecd06 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:25.671176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:25.680349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0845-78ba-4e4e-9b7d-47b3bd88e6f3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:25.684811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f77dd-f647-4c16-b049-8b856ef40735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:25.685608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f77dd-f647-4c16-b049-8b856ef40735 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.685883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f77dd-f647-4c16-b049-8b856ef40735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.686162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f77dd-f647-4c16-b049-8b856ef40735 admin admin] PATH_INFO: `/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.687322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f77dd-f647-4c16-b049-8b856ef40735 admin admin] RBAC: Authorizing `identity:get_project(project_id=6ac3f1468bb24c21b6ce54b52bb880b6)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:25.689296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f77dd-f647-4c16-b049-8b856ef40735 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:25.690895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 598/1189] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:53:25 2021] GET /identity/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:25.696518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:25.705671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300f24-a521-42e7-bf3c-45da3056ded8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:25.710075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20735a5d-9e10-46ba-9d20-1e83fc1f8a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:25.710923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20735a5d-9e10-46ba-9d20-1e83fc1f8a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:25.711200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20735a5d-9e10-46ba-9d20-1e83fc1f8a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:25.711469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20735a5d-9e10-46ba-9d20-1e83fc1f8a0f admin admin] PATH_INFO: `/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6/users/edf8721434614a50a5e855659acecd06/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:25.713379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20735a5d-9e10-46ba-9d20-1e83fc1f8a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac3f1468bb24c21b6ce54b52bb880b6, user_id=edf8721434614a50a5e855659acecd06, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:25.716478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20735a5d-9e10-46ba-9d20-1e83fc1f8a0f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:25.728788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 592/1190] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:53:25 2021] PUT /identity/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6/users/edf8721434614a50a5e855659acecd06/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:53:28.089249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e41712-6bc8-4e49-b35a-38d43addf473 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.089784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e41712-6bc8-4e49-b35a-38d43addf473 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.089784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e41712-6bc8-4e49-b35a-38d43addf473 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.092017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 599/1191] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:53:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:53:28.099593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.099972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.100135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.117175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:53:28.118409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:53:28.172664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 593/1192] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:53:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:53:28.196359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e41712-6bc8-4e49-b35a-38d43addf473 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:28.208555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e41712-6bc8-4e49-b35a-38d43addf473 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:28.212812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:28.213563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.213838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.214106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.224428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:53:28.231216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:53:28.232320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 600/1193] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:53:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:53:28.238560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:28.247040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f73fed-fab4-4dfe-a9d7-9e1899810cac None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:28.251422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:28.252055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.252332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.252603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.253354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:28.253655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:28.255263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:28.263555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 594/1194] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:53:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:28.269436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:28.280653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa655644-3325-488f-af93-9647620697e0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:28.285372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:28.286214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.286493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.286760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] PATH_INFO: `/v3/users/edf8721434614a50a5e855659acecd06` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.287941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] RBAC: Authorizing `identity:get_user(user_id=edf8721434614a50a5e855659acecd06)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:28.290021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:28.291584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 601/1195] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Dec 15 12:53:28 2021] GET /identity/v3/users/edf8721434614a50a5e855659acecd06 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:53:28.297146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:28.306169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0efb1-6af9-46d0-a0b2-f3e7e7f3e2da admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:28.310515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:28.311116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.311392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.311659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.319002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:28.320680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:28.329592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 595/1196] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:53:28 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:53:28.335337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:28.344928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c45f4a-9c23-4fb9-8719-e4faef60e13b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:28.349261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee412810-b0f0-4224-a9d8-8b4b679dd0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:28.350035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee412810-b0f0-4224-a9d8-8b4b679dd0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.350339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee412810-b0f0-4224-a9d8-8b4b679dd0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.350612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee412810-b0f0-4224-a9d8-8b4b679dd0aa admin admin] PATH_INFO: `/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.351751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee412810-b0f0-4224-a9d8-8b4b679dd0aa admin admin] RBAC: Authorizing `identity:get_project(project_id=6ac3f1468bb24c21b6ce54b52bb880b6)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:28.353724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee412810-b0f0-4224-a9d8-8b4b679dd0aa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:28.355455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 602/1197] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:53:28 2021] GET /identity/v3/projects/6ac3f1468bb24c21b6ce54b52bb880b6 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:53:28.361108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:53:28.369183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac57ec-5f12-456c-afcb-0bc2b1345052 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:53:28.373706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:53:28.374317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:53:28.374593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:53:28.374865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:53:28.375683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=6ac3f1468bb24c21b6ce54b52bb880b6, user.id=edf8721434614a50a5e855659acecd06) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:53:28.375971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:53:28.377723 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4d1e9-e08b-4523-9510-2e200c8cbe90 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:53:28.383388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 596/1198] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:53:28 2021] GET /identity/v3/role_assignments?user.id=edf8721434614a50a5e855659acecd06&scope.project.id=6ac3f1468bb24c21b6ce54b52bb880b6&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:26.475232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad59bc8-09d7-490e-ab8b-3947edf3ce9e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:26.475816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad59bc8-09d7-490e-ab8b-3947edf3ce9e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:26.475816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad59bc8-09d7-490e-ab8b-3947edf3ce9e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:26.477971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 603/1199] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:26.484751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:26.485280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:26.485460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:26.509244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:26.510753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:26.521771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 597/1200] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:54:26.552995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad59bc8-09d7-490e-ab8b-3947edf3ce9e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:26.568983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad59bc8-09d7-490e-ab8b-3947edf3ce9e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:26.575172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:26.576428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:26.577058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:26.577705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:26.595614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:26.597707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:26.625865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:26.630184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 604/1201] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:26.636422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:26.648037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a4162-5c83-49f7-b8f5-d9897819397b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:26.653884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:26.654838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:26.655305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:26.655724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:26.656965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:26.657426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:26.659406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d7763-64ef-4e7d-b8b5-5dccf14f187b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:26.678192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 598/1202] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:26.685359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:26.701407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030494fc-ef89-4433-8416-dedcc8c0389b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:26.707363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6eae-e186-4f59-ab20-75437466dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:26.708087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6eae-e186-4f59-ab20-75437466dd6d admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:26.708464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6eae-e186-4f59-ab20-75437466dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:26.708693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6eae-e186-4f59-ab20-75437466dd6d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:26.709526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6eae-e186-4f59-ab20-75437466dd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:26.711910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6eae-e186-4f59-ab20-75437466dd6d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:26.740516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 605/1203] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Dec 15 12:54:26 2021] POST /identity/v3/users => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:54:29.611662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca77ed6-fd66-4e45-b5a8-4ea3f956cd25 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.612243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca77ed6-fd66-4e45-b5a8-4ea3f956cd25 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.612243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca77ed6-fd66-4e45-b5a8-4ea3f956cd25 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.613979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 599/1204] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:29.622765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.622765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.622765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.652360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:29.653655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:29.662216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 606/1205] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:54:29.689702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca77ed6-fd66-4e45-b5a8-4ea3f956cd25 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:29.703538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca77ed6-fd66-4e45-b5a8-4ea3f956cd25 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:29.709020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:29.709802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.710077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.711359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.722756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:54:29.730570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:54:29.731950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 600/1206] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:29.739326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:29.749284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f115d3-9abb-4aba-a2c6-adea68c2ab69 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:29.754765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:29.755422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.755709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.756006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.756842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:29.757146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:29.759326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:29.769092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 607/1207] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:29.778609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:29.792263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b7a81-2985-4817-882f-563934e354b8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:29.797819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:29.798674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.798956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.799227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.815414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:29.818402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:29.837099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:29.838610 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 601/1208] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:29.845117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:29.858567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821812c-ac8a-4f5e-9788-398c3190d22b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:29.863638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:29.864248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.864562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.864906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.865705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:29.866042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:29.867944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:29.881613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 608/1209] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:29.888911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:29.901146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abea50-7423-4b97-b3c6-ecbd0a94ef38 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:29.905897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:29.907053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.907333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.907633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.916605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:29.918956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:29.936049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 12:54:29.943232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 602/1210] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:54:29.945348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:29.956500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510f1db-d87b-46fd-ae1a-4f9f28dcc701 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:29.961767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:29.962831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:29.963334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:29.963615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:29.964493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:29.964831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:29.967012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:29.987692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 609/1211] 10.222.0.57 () {56 vars in 1164 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:29.997255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:30.010176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf163e5f-f3d6-4e37-8a68-2ee3f3d38135 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:30.017236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:30.018420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:30.018954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:30.019331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:30.028266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:30.029999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:30.041028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 603/1212] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:54:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:54:30.047628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:30.058709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc559c6-1581-4f96-b391-9a5c1132cee1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:30.064619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:30.065473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:30.065781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:30.066059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:30.079174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:30.081468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:30.101540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:30.106186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 610/1213] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:30.109188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:30.119484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585b83f-7a2f-4370-b69b-e198c0713f22 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:30.124028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:30.124669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:30.124947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:30.125216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:30.125947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:30.126335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:30.128046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:30.141193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 604/1214] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:30.149057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:30.161855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050f31d-46cc-46b3-8600-beec542eeb1c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:30.167043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:30.167855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:30.168141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:30.168415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:30.175891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:30.177830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:30.193790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:54:30.201385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 611/1215] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:54:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:30.202656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:30.214378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d568a-f0f9-4a7d-a786-dc3fc08b0d72 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:30.220351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:30.221056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:30.221332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:30.221602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:30.222423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:30.222728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:30.224542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedef47-c66a-4adc-a91d-7bb9b5f743ab admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:30.236602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 605/1216] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:54:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:30.243968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:30.255942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100f418-6752-4099-9d49-92439ea24184 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:30.261006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:30.261626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:30.261907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:30.262197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:30.263027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=b6e9b03e57d84f5f8dea7284ed1449f2) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:30.263328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:30.265188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1aef26-4f0e-492a-ad32-fb6f38b76d2f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:30.271316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 612/1217] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:54:30 2021] GET /identity/v3/role_assignments?user.id=b6e9b03e57d84f5f8dea7284ed1449f2&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:32.917108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613346e7-7d40-45f3-95b3-389f7faba62d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:32.917632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613346e7-7d40-45f3-95b3-389f7faba62d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:32.917718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613346e7-7d40-45f3-95b3-389f7faba62d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:32.919982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 606/1218] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:32.926532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:32.926963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:32.927069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:32.944759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:32.945980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:32.954330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 613/1219] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:32.981768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613346e7-7d40-45f3-95b3-389f7faba62d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:32.995430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613346e7-7d40-45f3-95b3-389f7faba62d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.000774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.001561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.001915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.002273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.013446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:54:33.021315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:54:33.023313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 607/1220] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:54:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:33.029637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.039351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845803-8dba-41f7-b750-8af067d32520 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.043955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.044608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.044886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.045155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.045908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:33.046244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.047822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.055779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 614/1221] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:33.061958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.074037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ad9b2-3e10-4688-bab3-dde7bbe7e02e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.079408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.080203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.080482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.080755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.092579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.094607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.112588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:33.113763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 608/1222] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:54:33.120164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.130582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa8eca-3af6-4ab0-8091-48da7de11898 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.135580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.136270 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.136591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.136825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.137576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:33.137893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.139649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.152427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 615/1223] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:33.158881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.170781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0a56-27c0-4edc-90dd-0ef0ddf9c820 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.176304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.177236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.177609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.177917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.185914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.188483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.206269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 12:54:33.207636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 609/1224] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:54:33.216469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.228480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fd6fc-f681-4207-980d-25517ef4093e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.232941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.233611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.234129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.234441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.235615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:33.236082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.238455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.260234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 616/1225] 10.222.0.57 () {56 vars in 1164 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:33.271678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.283947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ecf09-9a93-4424-9a01-33c6ca38cbd8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.289359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.290127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.290445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.290716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.300722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.302645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.322109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:33.323619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 610/1226] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:33.329973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.340118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa851-8dbc-48c5-a408-01de47952983 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.344707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.345337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.345614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.345884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.346637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:33.346935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.348520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.359996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 617/1227] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:33.366096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.376339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8298-f298-461e-8916-a8380910736a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.382630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.383405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.383687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.383961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.390765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.392702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.406319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:54:33.407492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 611/1228] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:33.413827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.424291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789696de-ef16-4b1a-95c7-07a8484a343c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.429154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.429787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.430067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.430368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.431161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:33.431467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.433310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbc56d-2a73-448c-830d-b360de62acdc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.446439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 618/1229] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:54:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:33.453026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:33.464385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9a3f1-5c93-4d7e-84bb-da59eceebf73 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:33.468924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238066b-b295-47e4-b443-686f0ba2317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:33.469775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238066b-b295-47e4-b443-686f0ba2317e admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:33.470056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238066b-b295-47e4-b443-686f0ba2317e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:33.470362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238066b-b295-47e4-b443-686f0ba2317e admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/b6e9b03e57d84f5f8dea7284ed1449f2/roles/5bff488b9c2b4420a2265578c7b439d2` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:33.484954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238066b-b295-47e4-b443-686f0ba2317e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=b6e9b03e57d84f5f8dea7284ed1449f2, role_id=5bff488b9c2b4420a2265578c7b439d2)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:33.487716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238066b-b295-47e4-b443-686f0ba2317e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:33.500780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 612/1230] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:54:33 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/b6e9b03e57d84f5f8dea7284ed1449f2/roles/5bff488b9c2b4420a2265578c7b439d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:54:36.034414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b324-9c1b-4b24-bb4b-842416a9607a None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.035053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b324-9c1b-4b24-bb4b-842416a9607a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.035053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b324-9c1b-4b24-bb4b-842416a9607a None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.036924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 619/1231] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:36.043536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.044020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.044118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.061789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:36.063080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:36.125769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 613/1232] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:36.150793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b324-9c1b-4b24-bb4b-842416a9607a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.165788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b324-9c1b-4b24-bb4b-842416a9607a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.171191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.172012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.172316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.172584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.184332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:54:36.191550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 15 12:54:36.192782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 620/1233] 10.222.0.57 () {56 vars in 1123 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:36.200226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.209483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71574c70-319c-4553-bdf3-26c6cd19b65a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.214874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.215577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.215821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.216101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.216830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:36.217163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.218793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.229591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 614/1234] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:36.236517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.247013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfa5b2-40c6-466a-b350-b8932dcad3e5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.251715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.252586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.252870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.253139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.263297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.265119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.284129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:36.285941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 621/1235] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:36.292855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.303243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d84a-ca9e-4819-bd77-c8fd58874a20 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.308578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.309321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.309559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.309827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.310613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:36.310909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.312502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.328165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 615/1236] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:36.334685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.345845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc59d2-7aa5-46e0-8f2e-7ef9765e6997 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.350646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.351448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.351724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.352111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.360950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.363614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.380227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 12:54:36.381509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 622/1237] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:36.388793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.401229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e11a37-c851-48fd-a670-d92eeef8833b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.407606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.408390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.408786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.409064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.410031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:36.410360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.412174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.432142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 616/1238] 10.222.0.57 () {56 vars in 1164 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:36.438561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.449574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899cba-d1a4-42e6-a9b1-0d841dd985af admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.454320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.455003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.455320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.455586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.464736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.466571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.475947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 623/1239] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:54:36.483551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.495958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683e40-9090-405c-b6a3-da1751a1c6e6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.501773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.502581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.502854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.503119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.513926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.515772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.532609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:36.533944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 617/1240] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:36.540431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.549202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252e489-a684-4d2b-8763-9e38b82198d5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.555129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.556505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.557157 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.557530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.558567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:36.559083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.561581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.579337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 624/1241] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:36.585643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.596715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5ee37-35d9-4632-bed0-6365fca290f5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.601216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.601984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.602419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.602691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.609857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.611828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.624361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:54:36.625944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 618/1242] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:54:36.633944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.643690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955f3e2-3796-48d2-bb24-0ef924cc5239 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.648714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.649378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.649795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.650206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.651076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:36.651401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.653724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d2961-73f7-4ce4-975c-8be6f560c7f9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.668652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 625/1243] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:36.676560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:36.689183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83074925-f027-476e-81a2-eee202bad19a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:36.694978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:36.696389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:36.696389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:36.696389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:36.696991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] RBAC: Adding query filter params (role.id=5bff488b9c2b4420a2265578c7b439d2, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=b6e9b03e57d84f5f8dea7284ed1449f2) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:36.697304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:36.699374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe35e4a-92ef-4ff1-88d9-8dce3397d4f8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:36.705352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 619/1244] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:54:36 2021] GET /identity/v3/role_assignments?user.id=b6e9b03e57d84f5f8dea7284ed1449f2&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=5bff488b9c2b4420a2265578c7b439d2 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:39.227517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b7376-8fa6-4c07-bb7f-ded03522a01b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.228073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b7376-8fa6-4c07-bb7f-ded03522a01b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.228073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b7376-8fa6-4c07-bb7f-ded03522a01b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.230185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 626/1245] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:54:39.236980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.237407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.237647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.263309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:39.264550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:39.273811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 620/1246] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:39.301239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b7376-8fa6-4c07-bb7f-ded03522a01b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.315415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b7376-8fa6-4c07-bb7f-ded03522a01b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.320242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.321059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.321381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.321714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.332962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:54:39.340735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:54:39.342116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 627/1247] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:39.349176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.359107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02a29c-cccc-46af-b90c-09cbb3b63216 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.364108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.364949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.365235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.365512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.366923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:39.367226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.369117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.382186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 621/1248] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:39.385315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.395614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd7285-eb7c-4f8d-bfdd-67133b7a3217 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.411739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.413382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.413746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.414104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.427728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.430596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.451152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:39.458182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 628/1249] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:39.459380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.470660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efc9ef-b55a-434a-8007-65a8ff3d8aec admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.475177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.476314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.476591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.476861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.477626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:39.477884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.479667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.493376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 622/1250] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:39.500165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.509978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d048c-51e7-4209-9357-39de4a97e3bf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.514824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.515702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.516026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.516288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.525011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.527214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.541380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 12:54:39.542696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 629/1251] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:39.551106 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.563309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3718ceb-96c6-482e-9675-65d8d5cd469e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.568585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.569368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.569669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.570075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.571108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:39.571414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.573825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.591220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 623/1252] 10.222.0.57 () {56 vars in 1164 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:39.597583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.608319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb707a28-9b3a-455d-a008-637ff45b0ae3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.612975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.613591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.613866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.614136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.622325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.624128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.633061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 630/1253] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:54:39.639456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.649409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5aed-8c64-4807-a6d8-b9b497284687 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.653851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.654647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.654927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.655195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.666887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.668767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.687420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:39.688892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 624/1254] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:39.695429 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.704978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c682fea-281f-4388-8116-ce5f5806081f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.711019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.711782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.712045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.712414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.713104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:39.713423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.715210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.729144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 631/1255] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:39.735697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.746111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1f2e8-625e-419c-8367-5425cf2fcfb9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.751165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.752053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.752346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.752647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.760219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.762348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.778752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:54:39.780344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 625/1256] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:39.787305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.798554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fada55-fbde-4297-a809-7d795aeddd10 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.803417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.804125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.804467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.804716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.805578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:39.805908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.809999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940471aa-e395-44d2-aa6b-017a18600bf0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.821294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 632/1257] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:39.828442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:39.840332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8d1b-4fc7-4ec9-b85b-6f108b336f67 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:39.845389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:39.846020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:39.846555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:39.846851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:39.847706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=b6e9b03e57d84f5f8dea7284ed1449f2) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:39.847996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:39.850105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acbb17-4c79-4bfd-a4ac-a88371a5aa8a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:39.857880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 626/1258] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:54:39 2021] GET /identity/v3/role_assignments?user.id=b6e9b03e57d84f5f8dea7284ed1449f2&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:42.416916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fa256-9ae3-4589-90c5-5cbc3f268a4a None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.417509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fa256-9ae3-4589-90c5-5cbc3f268a4a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.417509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fa256-9ae3-4589-90c5-5cbc3f268a4a None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.419254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 633/1259] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:42.426209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.426647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.426845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.446818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:42.448638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:42.457025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 627/1260] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:42 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:42.488940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fa256-9ae3-4589-90c5-5cbc3f268a4a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.503159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fa256-9ae3-4589-90c5-5cbc3f268a4a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.509082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.510036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.510396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.510670 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.523947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:54:42.533564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:54:42.534889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 634/1261] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:42.542656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.551842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed9818-eed2-4c4b-bede-e8486c8d5690 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.558006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.558762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.559044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.559356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.560379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:42.560680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.563022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.572946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 628/1262] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:42.579171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.590869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c10c9-44b3-460b-b733-23822ce928be admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.596017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.596900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.597191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.597461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.610117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.611952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.630161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:42.631345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 635/1263] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:42.638034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.649957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536eb04-0caf-48a3-b12d-4878f9a1ce50 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.656124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.657125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.657470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.657955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.658882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:42.659398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.661411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.675544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 629/1264] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:42.682156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.693472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d0aa8-80c6-4d1c-a96e-fc30c335db56 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.698209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.699125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.699527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.699814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.707887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.710911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.728840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 12:54:42.730509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 636/1265] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:42.737023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.748051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64180460-e253-4405-b2f7-a490e4c948e1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.753609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.754378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.754657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.754932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.755780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:42.756078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.758460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.777941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 630/1266] 10.222.0.57 () {56 vars in 1164 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:42.785019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.796801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2f43-a272-41fb-97c7-a5b32a84df8c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.801764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.803048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.803182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.803650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.818678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.821562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.840675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:42.841944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 637/1267] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:42.848498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.859298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6833d-44d3-42c4-9bd1-380259c7622a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.863894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.864559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.864837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.865109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.865851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:42.866168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.867779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.880616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 631/1268] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:42.886074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.896246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721327d4-2a8b-4219-8255-ae0aa9c8ffaf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.901411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.902247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.902524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.902790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.910705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.913340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.927234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:54:42.928555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 638/1269] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:42.934950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.944897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c9f7-96b6-4a63-9ad1-f63395c055ad admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.949521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.950249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.950529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.950801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.951606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:42.951907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.953749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa05b3-c9d0-47c8-a67e-3325e9479197 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:42.967316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 632/1270] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:54:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:42.974222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:42.985640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af503c1-8967-4a5f-8a1c-36e6aa9723bc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:42.990377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784bc05-8d20-4c8f-8790-031925abd407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:42.991284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bc05-8d20-4c8f-8790-031925abd407 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:42.991559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bc05-8d20-4c8f-8790-031925abd407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:42.991826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784bc05-8d20-4c8f-8790-031925abd407 admin admin] PATH_INFO: `/v3/projects/98d37a74893744ea847160eb18f54c4e/users/b6e9b03e57d84f5f8dea7284ed1449f2/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:42.993882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bc05-8d20-4c8f-8790-031925abd407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d37a74893744ea847160eb18f54c4e, user_id=b6e9b03e57d84f5f8dea7284ed1449f2, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:42.996610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784bc05-8d20-4c8f-8790-031925abd407 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:43.010560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 639/1271] 10.222.0.57 () {58 vars in 1460 bytes} [Wed Dec 15 12:54:42 2021] PUT /identity/v3/projects/98d37a74893744ea847160eb18f54c4e/users/b6e9b03e57d84f5f8dea7284ed1449f2/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 12:54:45.392157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30caa4-c28c-4a9c-be2e-695269bba1aa None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.392713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30caa4-c28c-4a9c-be2e-695269bba1aa None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.392713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30caa4-c28c-4a9c-be2e-695269bba1aa None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.394520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 633/1272] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:45.400390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.400820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.400939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.418490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:45.419652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:45.473648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 640/1273] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:45.498746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30caa4-c28c-4a9c-be2e-695269bba1aa None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.515051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30caa4-c28c-4a9c-be2e-695269bba1aa None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.520912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.521746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.522030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.522332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.535347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 15 12:54:45.542597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 15 12:54:45.543771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 634/1274] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:54:45.550380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.559865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5631-cdbd-4c45-8fbd-0eae473aa5e4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.564325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.564970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.565245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.565517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.566320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:45.566622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.568197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.576102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 641/1275] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:45.582062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.592066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4df7d-8cbf-4877-a5a0-a3efc037e897 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.596656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.597414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.597696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.597969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.608377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.610214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.628252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:45.629357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 635/1276] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:45.635239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.644533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a4085-05f4-4bb4-ab09-3df716f00640 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.648913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.649532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.649809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.650077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.650832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:45.651131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.652689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.664867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 642/1277] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:45.670588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.681036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045d98a-f71a-4a8a-a5e8-18b434437b18 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.685458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.686299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.686575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.686841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.693708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.695722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.708943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 15 12:54:45.710572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 636/1278] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:45.716499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.726522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48236-b851-4304-b676-c8b9e066c37a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.730990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.731620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.731899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.732169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.732999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:45.733299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.735156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.752213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 643/1279] 10.222.0.57 () {56 vars in 1164 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:45.757872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.766972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075ecea-0948-4435-9d37-9af2a09edf87 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.771352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.772441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.772714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.772979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.780584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.782297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.791432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 637/1280] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:54:45.797106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.806344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16975605-be90-49dd-8a4b-6ce76a77f951 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.810794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.811552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.811903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.812088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.822092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.823912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.840473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 15 12:54:45.841592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 644/1281] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:45.847576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.856737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c9e13-0d72-4fdc-bb5f-1f64d64be167 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.861241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.861870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.862165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.862447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.863157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:45.863460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.865008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.876400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 638/1282] 10.222.0.57 () {56 vars in 1130 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 12:54:45.882620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.893342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b56e7-199f-4e05-a845-51cf6cb54ae4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.898333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.899033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.899307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.899576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.906426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.908322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.924268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING keystone.server.flask.application [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 15 12:54:45.925390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 645/1283] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:45.931604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.941134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af089db7-dc80-4d64-94f6-13a106e4d44c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.945708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.946377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.946660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.946933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.947720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:45.948023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.949835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ae305-1050-4e30-a0fa-52515e00d4ee admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.962006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 639/1284] 10.222.0.57 () {56 vars in 1169 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:45.967914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:45.978400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701e249-7cf9-44c7-b6a4-a639f0e4039c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:45.982753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:45.983354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:45.983629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:45.983896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:45.984713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] RBAC: Adding query filter params (role.id=a78d70a0713545a6a42a87be894a6d14, scope.project.id=98d37a74893744ea847160eb18f54c4e, user.id=b6e9b03e57d84f5f8dea7284ed1449f2) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:45.985013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:45.986849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e6e5-cf60-49f4-9c76-8688d220145c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:45.992414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 646/1285] 10.222.0.57 () {56 vars in 1395 bytes} [Wed Dec 15 12:54:45 2021] GET /identity/v3/role_assignments?user.id=b6e9b03e57d84f5f8dea7284ed1449f2&scope.project.id=98d37a74893744ea847160eb18f54c4e&role.id=a78d70a0713545a6a42a87be894a6d14 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:48.347168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ed10-7521-4d14-9f21-1845d3c22bad None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:48.347759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ed10-7521-4d14-9f21-1845d3c22bad None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:48.347759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992ed10-7521-4d14-9f21-1845d3c22bad None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:48.349461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 640/1286] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:48.355200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:48.355597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:48.355744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:48.372473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:48.373650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:48.381622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 647/1287] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:48.404023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992ed10-7521-4d14-9f21-1845d3c22bad None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:48.416074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992ed10-7521-4d14-9f21-1845d3c22bad None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:48.420374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:48.421128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:48.421408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:48.421681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:48.422371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:48.423931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:48.434560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 12:54:48.435644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 641/1288] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:54:48 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 15 12:54:48.441526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:48.450656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df2a33-5008-47b5-b769-db7cb3ed3af7 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:48.455053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:48.455682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:48.455957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:48.456225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:48.456929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:48.457229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:48.458838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504f51a-8336-4d58-aeb9-f3508b40221d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:48.463965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 648/1289] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Dec 15 12:54:48 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:48.469521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:48.478703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ea005-7ef0-4fee-a835-7b72dc961a3d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:48.483076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:48.483677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:48.483952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:48.484222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] PATH_INFO: `/v3/services` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:48.484916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:48.485214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:48.486758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02418e-8ae9-43b8-a090-daf88ab88214 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:48.491052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 642/1290] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Dec 15 12:54:48 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:50.809692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344bc12-4200-457b-a9e2-e8f4f8c83d45 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:50.810277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344bc12-4200-457b-a9e2-e8f4f8c83d45 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:50.810277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344bc12-4200-457b-a9e2-e8f4f8c83d45 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:50.812471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 649/1291] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:50.817797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77100-7a43-4f6b-9c80-304e76d81165 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:50.818200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77100-7a43-4f6b-9c80-304e76d81165 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:50.818597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe77100-7a43-4f6b-9c80-304e76d81165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:50.835814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8fe77100-7a43-4f6b-9c80-304e76d81165 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:50.836998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8fe77100-7a43-4f6b-9c80-304e76d81165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:50.844570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 643/1292] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:50.869582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344bc12-4200-457b-a9e2-e8f4f8c83d45 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:50.881430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344bc12-4200-457b-a9e2-e8f4f8c83d45 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:50.885672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9979b9-730f-44d0-b592-acc53bb9ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:50.886328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9979b9-730f-44d0-b592-acc53bb9ae3f admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:50.886601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9979b9-730f-44d0-b592-acc53bb9ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:50.886865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9979b9-730f-44d0-b592-acc53bb9ae3f admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:50.887592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9979b9-730f-44d0-b592-acc53bb9ae3f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:50.889153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9979b9-730f-44d0-b592-acc53bb9ae3f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:50.901825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 650/1293] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Dec 15 12:54:50 2021] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 12:54:53.238623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76243-22b1-43d6-a153-c93401d9f40c None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:53.239161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76243-22b1-43d6-a153-c93401d9f40c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:53.239161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa76243-22b1-43d6-a153-c93401d9f40c None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:53.240949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 644/1294] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:54:53.247436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:53.247896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:53.248147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:53.266785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:53.267981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:53.284850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 651/1295] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:53 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:53.308110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76243-22b1-43d6-a153-c93401d9f40c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:53.320080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa76243-22b1-43d6-a153-c93401d9f40c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:53.324407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:53.325172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:53.325452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:53.325725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:53.326430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:53.328031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:53.339257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 12:54:53.340359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 645/1296] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:54:53 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:53.346247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:53.355473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaf318-8845-43a6-8bea-3046b844d02d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:53.359947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:53.360578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:53.360858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:53.361127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:53.361840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:53.362139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:53.363731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:53.368627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 652/1297] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Dec 15 12:54:53 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:53.374393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:53.383475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32182c94-1a93-4049-b699-48b43c68ecb4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:53.387865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:53.388465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:53.388745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:53.389016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:53.389802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] RBAC: Adding query filter params (interface=public, service_id=3f1fa19cb8004003bcbeb753d06194f3, region_id=RegionOne) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:53.390104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:53.391658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e2b6-e898-4c3b-aae8-f5be88be9276 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:53.397071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 646/1298] 10.222.0.57 () {56 vars in 1272 bytes} [Wed Dec 15 12:54:53 2021] GET /identity/v3/endpoints?service_id=3f1fa19cb8004003bcbeb753d06194f3&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:53.402537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:53.412475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7af8a-23ad-4a68-aaa3-6306f589ee89 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:53.416929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e0e8-e794-4aea-a436-2fa9cd99de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:53.417528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e0e8-e794-4aea-a436-2fa9cd99de52 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:53.417808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e0e8-e794-4aea-a436-2fa9cd99de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:53.418080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e0e8-e794-4aea-a436-2fa9cd99de52 admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:53.418793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e0e8-e794-4aea-a436-2fa9cd99de52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:53.420307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e0e8-e794-4aea-a436-2fa9cd99de52 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:53.426780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 653/1299] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:54:53 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:54:55.888226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be54ea-5771-489c-9ead-b3fb53681673 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:55.888696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be54ea-5771-489c-9ead-b3fb53681673 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:55.888780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be54ea-5771-489c-9ead-b3fb53681673 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:55.890541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 647/1300] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:54:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:54:55.896536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:55.896956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:55.897079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:55.915134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:54:55.916320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:54:55.923890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 654/1301] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:54:55 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:54:55.946860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be54ea-5771-489c-9ead-b3fb53681673 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:55.958962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be54ea-5771-489c-9ead-b3fb53681673 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:55.963296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:55.964044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:55.964318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:55.964587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:55.965236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:55.966838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:55.977882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING keystone.server.flask.application [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 15 12:54:55.979007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 648/1302] 10.222.0.57 () {56 vars in 1138 bytes} [Wed Dec 15 12:54:55 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 15 12:54:55.985120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:55.996254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90e8bb-bd4c-402b-898b-57a0ce5c4174 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:56.001304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:56.001975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:56.002298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:56.002571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] PATH_INFO: `/v3/services` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:56.003283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 12:54:56.003584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:56.005162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8345fe9-3ece-4da2-856f-be620d17b75e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:56.010351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 655/1303] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Dec 15 12:54:55 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:54:56.016262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:54:56.026560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625b39c-66f1-4dfa-b8f0-4cbeef9becb3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:54:56.031182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522facc-6e2f-4baa-974a-a25bc546dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:54:56.031794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522facc-6e2f-4baa-974a-a25bc546dde0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:54:56.032069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522facc-6e2f-4baa-974a-a25bc546dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:54:56.032339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522facc-6e2f-4baa-974a-a25bc546dde0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:54:56.033077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522facc-6e2f-4baa-974a-a25bc546dde0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:54:56.034661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522facc-6e2f-4baa-974a-a25bc546dde0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:54:56.052422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 649/1304] 10.222.0.57 () {60 vars in 1165 bytes} [Wed Dec 15 12:54:56 2021] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 12:55:58.593756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d9d1-0d49-4ca3-b2a3-83d2c290c328 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:55:58.593756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d9d1-0d49-4ca3-b2a3-83d2c290c328 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:55:58.594633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9d9d1-0d49-4ca3-b2a3-83d2c290c328 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:55:58.596202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 656/1305] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:55:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:55:58.602234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18a3fc-0c29-4e09-8d9f-97eaaf11fb1b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:55:58.602234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18a3fc-0c29-4e09-8d9f-97eaaf11fb1b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:55:58.602852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18a3fc-0c29-4e09-8d9f-97eaaf11fb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:55:58.714835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7b18a3fc-0c29-4e09-8d9f-97eaaf11fb1b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:55:58.716331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7b18a3fc-0c29-4e09-8d9f-97eaaf11fb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:55:58.848020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 650/1306] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:55:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:55:58.872441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d9d1-0d49-4ca3-b2a3-83d2c290c328 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:55:58.874405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-7fd9d9d1-0d49-4ca3-b2a3-83d2c290c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:55:59.033794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9d9d1-0d49-4ca3-b2a3-83d2c290c328 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:55:59.144315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9eba4-4f1a-4da2-8146-cc484332ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:55:59.145323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9eba4-4f1a-4da2-8146-cc484332ed51 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:55:59.145790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9eba4-4f1a-4da2-8146-cc484332ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:55:59.146391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9eba4-4f1a-4da2-8146-cc484332ed51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:55:59.147428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9eba4-4f1a-4da2-8146-cc484332ed51 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:55:59.149998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9eba4-4f1a-4da2-8146-cc484332ed51 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:55:59.171272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 657/1307] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:55:58 2021] GET /identity/v3/projects => generated 2553 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:56:01.684271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af59a-4916-4e2c-87af-6570780cf1f9 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:01.684733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af59a-4916-4e2c-87af-6570780cf1f9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:01.684820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3af59a-4916-4e2c-87af-6570780cf1f9 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:01.686685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 651/1308] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:01.693180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a0df2-bff3-4595-b3af-11593784148b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:01.693646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a0df2-bff3-4595-b3af-11593784148b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:01.693739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a0df2-bff3-4595-b3af-11593784148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:01.762812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-7f2a0df2-bff3-4595-b3af-11593784148b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:01.764016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-7f2a0df2-bff3-4595-b3af-11593784148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:01.861324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 658/1309] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:01.912141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022ea67-d898-4c81-a694-eda9d41241dd None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:01.912427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022ea67-d898-4c81-a694-eda9d41241dd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:01.912709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022ea67-d898-4c81-a694-eda9d41241dd None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:01.914523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 652/1310] 10.222.0.57 () {54 vars in 964 bytes} [Wed Dec 15 12:56:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:01.920699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748ea9-f02e-45b5-8023-0d209a15cad6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:01.920986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748ea9-f02e-45b5-8023-0d209a15cad6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:01.921258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72748ea9-f02e-45b5-8023-0d209a15cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:01.993759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-72748ea9-f02e-45b5-8023-0d209a15cad6 None None] MFA Rules not processed for user `6300d566628547b48cbe60769799c1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:01.994861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-72748ea9-f02e-45b5-8023-0d209a15cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:02.067326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 659/1311] 10.222.0.57 () {58 vars in 1061 bytes} [Wed Dec 15 12:56:01 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:02.076518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022ea67-d898-4c81-a694-eda9d41241dd None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:02.078006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1022ea67-d898-4c81-a694-eda9d41241dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:02.178334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022ea67-d898-4c81-a694-eda9d41241dd None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:02.247668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:02.248218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:02.248493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:02.248760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:02.250980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:02.358362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:02.360333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a7558-64cf-44a9-9416-30fb18114b96 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:02.377862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 653/1312] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:05.051725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653dfc-1ff7-4fe0-9877-e22a4e6a2328 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:05.052244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653dfc-1ff7-4fe0-9877-e22a4e6a2328 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:05.052550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20653dfc-1ff7-4fe0-9877-e22a4e6a2328 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:05.055322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 660/1313] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:05.061146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3cdcd-0801-46a0-ac94-1ea6e88f3397 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:05.061586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3cdcd-0801-46a0-ac94-1ea6e88f3397 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:05.061683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3cdcd-0801-46a0-ac94-1ea6e88f3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:05.122989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-46a3cdcd-0801-46a0-ac94-1ea6e88f3397 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:05.124100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-46a3cdcd-0801-46a0-ac94-1ea6e88f3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:05.214815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 654/1314] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:05.254759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20653dfc-1ff7-4fe0-9877-e22a4e6a2328 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:05.256295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-20653dfc-1ff7-4fe0-9877-e22a4e6a2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:05.355776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20653dfc-1ff7-4fe0-9877-e22a4e6a2328 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:05.425644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:05.426308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:05.426588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:05.426856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:05.428493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:05.530721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:05.532171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5262e0-c032-4e42-aeb3-07dbb3f8eda8 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:05.549432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 661/1315] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:08.179971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d15c-0606-41dc-b0d5-1505257dd7e3 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:08.180493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d15c-0606-41dc-b0d5-1505257dd7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:08.180584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d15c-0606-41dc-b0d5-1505257dd7e3 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:08.182357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 655/1316] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:08.188070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:08.188513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:08.188604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:08.249962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:08.251172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:08.341517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 662/1317] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:08.376975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d15c-0606-41dc-b0d5-1505257dd7e3 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:08.378511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1889d15c-0606-41dc-b0d5-1505257dd7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:08.500458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d15c-0606-41dc-b0d5-1505257dd7e3 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:08.588472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32edc7d-3005-4199-8c10-83b87952889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:08.589306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32edc7d-3005-4199-8c10-83b87952889e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:08.589585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32edc7d-3005-4199-8c10-83b87952889e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:08.589851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32edc7d-3005-4199-8c10-83b87952889e admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:08.599718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32edc7d-3005-4199-8c10-83b87952889e admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:08.601775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32edc7d-3005-4199-8c10-83b87952889e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:08.603469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 656/1318] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:56:08 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:56:08.615987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:08.617182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:08.705117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a282e-ed96-4a67-a9a5-2fa3dfed65ce None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:08.773757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:08.774349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:08.774626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:08.774893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:08.777015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:08.878807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:08.880231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e940f-4dd1-443b-a63f-056542fe94a3 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:08.897807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 663/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:11.756087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586f46-f006-45ed-80f8-1fe1c5601b83 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:11.756620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586f46-f006-45ed-80f8-1fe1c5601b83 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:11.756620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95586f46-f006-45ed-80f8-1fe1c5601b83 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:11.758428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 657/1320] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:11.764000 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b95dad-2425-4879-b012-16e9a3af7d4b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:11.764442 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b95dad-2425-4879-b012-16e9a3af7d4b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:11.764556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b95dad-2425-4879-b012-16e9a3af7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:11.828749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a0b95dad-2425-4879-b012-16e9a3af7d4b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:11.829960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a0b95dad-2425-4879-b012-16e9a3af7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:11.920092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 664/1321] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:11.955327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586f46-f006-45ed-80f8-1fe1c5601b83 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:11.956829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-95586f46-f006-45ed-80f8-1fe1c5601b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:12.075373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95586f46-f006-45ed-80f8-1fe1c5601b83 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:12.161428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2651e-05e8-4e0a-a546-8d62663108d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:12.162288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2651e-05e8-4e0a-a546-8d62663108d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:12.162565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2651e-05e8-4e0a-a546-8d62663108d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:12.162831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2651e-05e8-4e0a-a546-8d62663108d5 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:12.172577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2651e-05e8-4e0a-a546-8d62663108d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:12.174639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f2651e-05e8-4e0a-a546-8d62663108d5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:12.176563 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 658/1322] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:56:11 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:56:12.205312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b230-2f0b-4111-8223-26e4ad8be94e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:12.205595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b230-2f0b-4111-8223-26e4ad8be94e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:12.205927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b230-2f0b-4111-8223-26e4ad8be94e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:12.207776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 665/1323] 10.222.0.57 () {54 vars in 964 bytes} [Wed Dec 15 12:56:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:12.214356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fe3e0-a14f-40af-a850-e88da337284e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:12.214642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fe3e0-a14f-40af-a850-e88da337284e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:12.214918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fe3e0-a14f-40af-a850-e88da337284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:12.288165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-1c5fe3e0-a14f-40af-a850-e88da337284e None None] MFA Rules not processed for user `6300d566628547b48cbe60769799c1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:12.289349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1c5fe3e0-a14f-40af-a850-e88da337284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:12.360612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 659/1324] 10.222.0.57 () {58 vars in 1061 bytes} [Wed Dec 15 12:56:12 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:12.369663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b230-2f0b-4111-8223-26e4ad8be94e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:12.371191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e501b230-2f0b-4111-8223-26e4ad8be94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:12.468821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b230-2f0b-4111-8223-26e4ad8be94e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:12.539144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:12.539776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:12.540050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:12.540319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:12.541936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:12.644077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:12.645508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee80c2-1fcf-4c88-af08-a27eb60bb079 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:12.663236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 666/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:16.149166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c2d8e-916d-47dd-b7a9-5d7ba0e4c381 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:16.149683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c2d8e-916d-47dd-b7a9-5d7ba0e4c381 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:16.149826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c2d8e-916d-47dd-b7a9-5d7ba0e4c381 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:16.151919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 660/1326] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:16.157814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0f88-a1a3-4d36-b6dd-7d2b2bd7e39a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:16.159086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0f88-a1a3-4d36-b6dd-7d2b2bd7e39a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:16.159086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0f88-a1a3-4d36-b6dd-7d2b2bd7e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:16.221919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-298e0f88-a1a3-4d36-b6dd-7d2b2bd7e39a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:16.223174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-298e0f88-a1a3-4d36-b6dd-7d2b2bd7e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:16.316730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 667/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:16.353412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c2d8e-916d-47dd-b7a9-5d7ba0e4c381 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:16.355029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bb8c2d8e-916d-47dd-b7a9-5d7ba0e4c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:16.457845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c2d8e-916d-47dd-b7a9-5d7ba0e4c381 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:16.528739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:16.529380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:16.529683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:16.529980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:16.531646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:16.634761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:16.638181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bea729-da9d-421d-ae85-04ee51f3c7a9 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:16.654971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 661/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:19.088191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ba5d-4dc5-4c9d-af8b-cabd1ba0c442 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:19.088736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ba5d-4dc5-4c9d-af8b-cabd1ba0c442 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:19.088736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ba5d-4dc5-4c9d-af8b-cabd1ba0c442 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:19.090517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 668/1329] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:19.096917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6436a-af34-4f86-8327-081cd61dd458 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:19.097348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6436a-af34-4f86-8327-081cd61dd458 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:19.097503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6436a-af34-4f86-8327-081cd61dd458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:19.160150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5ca6436a-af34-4f86-8327-081cd61dd458 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:19.161345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5ca6436a-af34-4f86-8327-081cd61dd458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:19.265123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 662/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:56:19.304183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ba5d-4dc5-4c9d-af8b-cabd1ba0c442 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:19.305829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e9c6ba5d-4dc5-4c9d-af8b-cabd1ba0c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:19.403661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ba5d-4dc5-4c9d-af8b-cabd1ba0c442 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:19.472462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:19.473088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:19.473361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:19.473632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:19.475293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:19.577931 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:19.579384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d5689-f5d2-4ff2-b261-a127f4624da5 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:19.596898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 669/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:21.991585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0865d8-66e1-4819-81c2-c98e3a4a6fb8 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:21.992146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0865d8-66e1-4819-81c2-c98e3a4a6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:21.992146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0865d8-66e1-4819-81c2-c98e3a4a6fb8 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:21.993905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 663/1332] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:21.999630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:22.000064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:22.000169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:22.062375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:22.063561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:22.158334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 670/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:22.192012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0865d8-66e1-4819-81c2-c98e3a4a6fb8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:22.193571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-be0865d8-66e1-4819-81c2-c98e3a4a6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:22.312488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0865d8-66e1-4819-81c2-c98e3a4a6fb8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:22.404841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff028f2-e527-4aba-a958-4d502eef5b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:22.405692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff028f2-e527-4aba-a958-4d502eef5b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:22.405969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff028f2-e527-4aba-a958-4d502eef5b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:22.406268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff028f2-e527-4aba-a958-4d502eef5b95 admin admin] PATH_INFO: `/v3/projects/f1638968175244ce8a396b15be58b4e8` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:22.415612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff028f2-e527-4aba-a958-4d502eef5b95 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1638968175244ce8a396b15be58b4e8)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:22.417655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff028f2-e527-4aba-a958-4d502eef5b95 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:22.419350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 664/1334] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Dec 15 12:56:22 2021] GET /identity/v3/projects/f1638968175244ce8a396b15be58b4e8 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 12:56:22.431273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:22.432466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:22.519139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68af0-b7b3-4b7c-9b83-13df08e45639 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:22.602914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:22.603555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:22.603827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:22.604092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:22.605720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:22.715086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:22.716522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a7d2d-9f16-4a64-bedd-2152756df6e7 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:22.734630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 671/1335] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:25.308716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dbb7-05c3-42a7-b30a-bc5891cad79e None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:25.309285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dbb7-05c3-42a7-b30a-bc5891cad79e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:25.309285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dbb7-05c3-42a7-b30a-bc5891cad79e None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:25.311075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 665/1336] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:25.316615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175590-de0a-44d0-9682-61ef75890268 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:25.317005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175590-de0a-44d0-9682-61ef75890268 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:25.317180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb175590-de0a-44d0-9682-61ef75890268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:25.385503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-fb175590-de0a-44d0-9682-61ef75890268 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:25.387649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-fb175590-de0a-44d0-9682-61ef75890268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:25.489814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 672/1337] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:25.528676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55dbb7-05c3-42a7-b30a-bc5891cad79e None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:25.531270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bb55dbb7-05c3-42a7-b30a-bc5891cad79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:25.628073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55dbb7-05c3-42a7-b30a-bc5891cad79e None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:25.697883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:25.698548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:25.698830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:25.699100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:25.700727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:25.803466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:25.804895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebfc4-c802-4991-b1e7-431df0cdbf6e service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:25.822398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 666/1338] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:28.280616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4310-3e94-4938-9047-589959b750cb None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:28.281168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4310-3e94-4938-9047-589959b750cb None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:28.281329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc4310-3e94-4938-9047-589959b750cb None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:28.283242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 673/1339] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:28.289451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd2a6-5e1d-4bea-bc4a-713ec83b7318 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:28.290496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd2a6-5e1d-4bea-bc4a-713ec83b7318 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:28.290496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd2a6-5e1d-4bea-bc4a-713ec83b7318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:28.352140 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-316bd2a6-5e1d-4bea-bc4a-713ec83b7318 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:28.353331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-316bd2a6-5e1d-4bea-bc4a-713ec83b7318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:28.443811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 667/1340] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:28.485344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4310-3e94-4938-9047-589959b750cb None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:28.486912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6bfc4310-3e94-4938-9047-589959b750cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:28.584531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc4310-3e94-4938-9047-589959b750cb None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:28.657056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:28.657694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:28.657968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:28.658267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:28.659898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:28.765461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:28.766912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674398dc-ac55-452b-9518-4ba5e1fe7b98 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:28.784025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 674/1341] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:31.476880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f125-4f35-45ef-8a5e-6492822c85cc None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:31.477401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f125-4f35-45ef-8a5e-6492822c85cc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:31.477524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7f125-4f35-45ef-8a5e-6492822c85cc None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:31.479301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 668/1342] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:31.485037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797f08-d400-4de4-bd36-21035911423f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:31.485435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797f08-d400-4de4-bd36-21035911423f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:31.485590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f797f08-d400-4de4-bd36-21035911423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:31.554235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2f797f08-d400-4de4-bd36-21035911423f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:31.555438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2f797f08-d400-4de4-bd36-21035911423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:31.658718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 675/1343] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:31.696565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f125-4f35-45ef-8a5e-6492822c85cc None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:31.698673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-45e7f125-4f35-45ef-8a5e-6492822c85cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:31.788845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7f125-4f35-45ef-8a5e-6492822c85cc None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:31.792379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa428f-2405-4c36-bc1e-c169baf68bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:31.793006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa428f-2405-4c36-bc1e-c169baf68bcf service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:31.793282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa428f-2405-4c36-bc1e-c169baf68bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:31.793552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa428f-2405-4c36-bc1e-c169baf68bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:31.802022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa428f-2405-4c36-bc1e-c169baf68bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:31.803485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa428f-2405-4c36-bc1e-c169baf68bcf service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:31.812701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 669/1344] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:56:36.130856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eff7f-1d52-4d42-983b-a1fb39ca2bbc None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:36.131376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eff7f-1d52-4d42-983b-a1fb39ca2bbc None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:36.131376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547eff7f-1d52-4d42-983b-a1fb39ca2bbc None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:36.133102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 676/1345] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:36.138858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac419-3431-4fff-b68a-d965bbd6e1af None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:36.139293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac419-3431-4fff-b68a-d965bbd6e1af None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:36.139418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac419-3431-4fff-b68a-d965bbd6e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:36.156805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-f75ac419-3431-4fff-b68a-d965bbd6e1af None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:36.157995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f75ac419-3431-4fff-b68a-d965bbd6e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:36.165768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 670/1346] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:36.206847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eff7f-1d52-4d42-983b-a1fb39ca2bbc None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:36.219675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547eff7f-1d52-4d42-983b-a1fb39ca2bbc None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:36.223215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924da8-11a9-4f5c-a40f-fac01caefdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:36.223858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924da8-11a9-4f5c-a40f-fac01caefdac service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:36.224136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924da8-11a9-4f5c-a40f-fac01caefdac service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:36.224405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924da8-11a9-4f5c-a40f-fac01caefdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:36.233817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924da8-11a9-4f5c-a40f-fac01caefdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:36.235553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e924da8-11a9-4f5c-a40f-fac01caefdac service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:36.244800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 677/1347] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:56:39.214475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94fef-f5fc-43f2-a796-5dfed76db3da None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:39.215221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94fef-f5fc-43f2-a796-5dfed76db3da None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:39.215221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94fef-f5fc-43f2-a796-5dfed76db3da None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:39.217442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 671/1348] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:39.224797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334273-4c1e-4cb1-8cac-d69ba8abb02c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:39.225260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334273-4c1e-4cb1-8cac-d69ba8abb02c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:39.225391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334273-4c1e-4cb1-8cac-d69ba8abb02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:39.248469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-df334273-4c1e-4cb1-8cac-d69ba8abb02c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:39.249674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-df334273-4c1e-4cb1-8cac-d69ba8abb02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:39.258070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 678/1349] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:39.296519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94fef-f5fc-43f2-a796-5dfed76db3da None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:39.307172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94fef-f5fc-43f2-a796-5dfed76db3da None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:39.311283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb40154-69f7-4357-9695-17367414844b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:39.311914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40154-69f7-4357-9695-17367414844b service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:39.312193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40154-69f7-4357-9695-17367414844b service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:39.312464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb40154-69f7-4357-9695-17367414844b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:39.321294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb40154-69f7-4357-9695-17367414844b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:39.322749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb40154-69f7-4357-9695-17367414844b service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:39.332688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 672/1350] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:43.778631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e9f5-2224-4833-8661-048d45bfe158 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:43.779166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e9f5-2224-4833-8661-048d45bfe158 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:43.779166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129e9f5-2224-4833-8661-048d45bfe158 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:43.781087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 679/1351] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:43.786631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6101-1935-48c9-a659-e7ab636bc218 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:43.787059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6101-1935-48c9-a659-e7ab636bc218 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:43.787200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6101-1935-48c9-a659-e7ab636bc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:43.805104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-256d6101-1935-48c9-a659-e7ab636bc218 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:43.806341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-256d6101-1935-48c9-a659-e7ab636bc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:43.815195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 673/1352] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:43.855716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e9f5-2224-4833-8661-048d45bfe158 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:43.866765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129e9f5-2224-4833-8661-048d45bfe158 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:43.870329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4cffc-91c4-42c3-be4f-009468f123f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:43.870961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4cffc-91c4-42c3-be4f-009468f123f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:43.871236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4cffc-91c4-42c3-be4f-009468f123f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:43.871796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4cffc-91c4-42c3-be4f-009468f123f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:43.881637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4cffc-91c4-42c3-be4f-009468f123f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:43.883094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4cffc-91c4-42c3-be4f-009468f123f6 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:43.893052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 680/1353] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:56:48.807028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d3563-62db-4a30-9ff7-995eab9891ce None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:48.808328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d3563-62db-4a30-9ff7-995eab9891ce None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:48.809296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d3563-62db-4a30-9ff7-995eab9891ce None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:48.814050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 674/1354] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 12:56:48 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:48.820156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35a73-c5e3-41e7-9434-bb581d092345 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:48.820618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35a73-c5e3-41e7-9434-bb581d092345 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:48.820706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35a73-c5e3-41e7-9434-bb581d092345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:48.903783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b4e35a73-c5e3-41e7-9434-bb581d092345 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:48.907101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b4e35a73-c5e3-41e7-9434-bb581d092345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:49.057259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 681/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 12:56:48 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:53.405546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4a390-29c7-4821-8fb2-4c39dd1c0162 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:53.406110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4a390-29c7-4821-8fb2-4c39dd1c0162 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:53.406110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4a390-29c7-4821-8fb2-4c39dd1c0162 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:53.408097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 675/1356] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 12:56:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:53.413293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3974-1aec-4c36-a735-6237b53ef785 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:53.414183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3974-1aec-4c36-a735-6237b53ef785 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:53.414724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3974-1aec-4c36-a735-6237b53ef785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:53.435647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3d5b3974-1aec-4c36-a735-6237b53ef785 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:53.436849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3d5b3974-1aec-4c36-a735-6237b53ef785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:53.446302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 682/1357] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 12:56:53 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:54.800474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a49ff-0305-44ee-8223-9ec315a9f44b None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:54.801025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a49ff-0305-44ee-8223-9ec315a9f44b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:54.801830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a49ff-0305-44ee-8223-9ec315a9f44b None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:54.803750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 676/1358] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 12:56:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:54.810772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae3cd6-fc52-4bae-b121-3b3d071e1de0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:54.811221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae3cd6-fc52-4bae-b121-3b3d071e1de0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:54.811436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae3cd6-fc52-4bae-b121-3b3d071e1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:54.829797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1dae3cd6-fc52-4bae-b121-3b3d071e1de0 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:54.831014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1dae3cd6-fc52-4bae-b121-3b3d071e1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:54.839669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 683/1359] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 12:56:54 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:58.596954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cff655-4cf7-4ed4-85e3-bf7caa4d4e43 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:58.597447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cff655-4cf7-4ed4-85e3-bf7caa4d4e43 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:58.597447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cff655-4cf7-4ed4-85e3-bf7caa4d4e43 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:58.599383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 677/1360] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:56:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:58.605229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc004b7-a61a-4568-8b5c-d458b03b656c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:58.605684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc004b7-a61a-4568-8b5c-d458b03b656c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:58.606005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc004b7-a61a-4568-8b5c-d458b03b656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:58.623990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ddc004b7-a61a-4568-8b5c-d458b03b656c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:58.625662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ddc004b7-a61a-4568-8b5c-d458b03b656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:58.633655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 684/1361] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:56:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:56:58.684878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bc93c-1e3e-4fc2-9b88-6ef474b089b7 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:58.685371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bc93c-1e3e-4fc2-9b88-6ef474b089b7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:58.685747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bc93c-1e3e-4fc2-9b88-6ef474b089b7 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:58.687674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 678/1362] 10.222.0.57 () {54 vars in 961 bytes} [Wed Dec 15 12:56:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:56:58.693356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cacfb-dec3-4bef-9ee3-f767e655729a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:58.693644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cacfb-dec3-4bef-9ee3-f767e655729a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:58.693916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cacfb-dec3-4bef-9ee3-f767e655729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:58.748317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d58cacfb-dec3-4bef-9ee3-f767e655729a None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:56:58.749875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d58cacfb-dec3-4bef-9ee3-f767e655729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:56:58.844333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 685/1363] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Dec 15 12:56:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:56:58.852206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bc93c-1e3e-4fc2-9b88-6ef474b089b7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:56:58.866836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bc93c-1e3e-4fc2-9b88-6ef474b089b7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:56:58.872827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc70ab1-a61a-4097-89e8-48d09a536e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:56:58.873656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc70ab1-a61a-4097-89e8-48d09a536e4b service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:56:58.873936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc70ab1-a61a-4097-89e8-48d09a536e4b service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:56:58.874393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc70ab1-a61a-4097-89e8-48d09a536e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:56:58.882903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc70ab1-a61a-4097-89e8-48d09a536e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:56:58.884490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc70ab1-a61a-4097-89e8-48d09a536e4b service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:56:58.894647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 679/1364] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:56:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:01.481317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ceb1-6f14-45d0-925b-00f5e734fade None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:01.481860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ceb1-6f14-45d0-925b-00f5e734fade None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:01.481860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9ceb1-6f14-45d0-925b-00f5e734fade None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:01.483787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 686/1365] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:01.489258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac53ccc-7d85-4d53-968e-34c7efc2bf84 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:01.489672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac53ccc-7d85-4d53-968e-34c7efc2bf84 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:01.489797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac53ccc-7d85-4d53-968e-34c7efc2bf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:01.508263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4ac53ccc-7d85-4d53-968e-34c7efc2bf84 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:01.509767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4ac53ccc-7d85-4d53-968e-34c7efc2bf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:01.519920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 680/1366] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:01.569134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ceb1-6f14-45d0-925b-00f5e734fade None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:01.590296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9ceb1-6f14-45d0-925b-00f5e734fade None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:01.595731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f362-8a4b-41c2-b6a9-3e456ee1f282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:01.596356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f362-8a4b-41c2-b6a9-3e456ee1f282 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:01.596769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f362-8a4b-41c2-b6a9-3e456ee1f282 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:01.597003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f362-8a4b-41c2-b6a9-3e456ee1f282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:01.606334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005f362-8a4b-41c2-b6a9-3e456ee1f282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:01.608003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005f362-8a4b-41c2-b6a9-3e456ee1f282 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:01.627748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 687/1367] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:04.326490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dea4b-c058-4066-bea5-aca220971403 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:04.326984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dea4b-c058-4066-bea5-aca220971403 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:04.326984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dea4b-c058-4066-bea5-aca220971403 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:04.328722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 681/1368] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:04.334642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84437ff-2cce-496b-8338-932fddb108f8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:04.335111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84437ff-2cce-496b-8338-932fddb108f8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:04.335189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84437ff-2cce-496b-8338-932fddb108f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:04.355379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a84437ff-2cce-496b-8338-932fddb108f8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:04.356559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a84437ff-2cce-496b-8338-932fddb108f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:04.364967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 688/1369] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:04.413629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0542e-7619-485f-90d8-4adc71ce6cea None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:04.413907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0542e-7619-485f-90d8-4adc71ce6cea None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:04.414403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0542e-7619-485f-90d8-4adc71ce6cea None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:04.416159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 682/1370] 10.222.0.57 () {54 vars in 961 bytes} [Wed Dec 15 12:57:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:04.422958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4e0b-6cf3-4afb-88ec-53ab6e03b6ab None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:04.424102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4e0b-6cf3-4afb-88ec-53ab6e03b6ab None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:04.424392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a4e0b-6cf3-4afb-88ec-53ab6e03b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:04.445548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-9d0a4e0b-6cf3-4afb-88ec-53ab6e03b6ab None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:04.447151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9d0a4e0b-6cf3-4afb-88ec-53ab6e03b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:04.458083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 689/1371] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Dec 15 12:57:04 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:04.467257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0542e-7619-485f-90d8-4adc71ce6cea None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:04.482703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0542e-7619-485f-90d8-4adc71ce6cea None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:04.488561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf364-d5ff-4cb5-bba2-8612a46d447f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:04.489845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf364-d5ff-4cb5-bba2-8612a46d447f service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:04.490128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf364-d5ff-4cb5-bba2-8612a46d447f service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:04.490461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf364-d5ff-4cb5-bba2-8612a46d447f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:04.500558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf364-d5ff-4cb5-bba2-8612a46d447f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:04.502385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf364-d5ff-4cb5-bba2-8612a46d447f service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:04.513350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 683/1372] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:06.696066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269810ae-3d1c-423a-b36b-ae6860a6bad7 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.697138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269810ae-3d1c-423a-b36b-ae6860a6bad7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.697491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269810ae-3d1c-423a-b36b-ae6860a6bad7 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.699697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 690/1373] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:06.705880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53bc3a-569f-409f-adf3-14105848a6bc None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.706365 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53bc3a-569f-409f-adf3-14105848a6bc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.706519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53bc3a-569f-409f-adf3-14105848a6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.724434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7d53bc3a-569f-409f-adf3-14105848a6bc None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:06.725629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7d53bc3a-569f-409f-adf3-14105848a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:06.734175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 684/1374] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:57:06.792745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61fc1-4dac-4b40-9c48-5917aacb8cc2 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.793098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61fc1-4dac-4b40-9c48-5917aacb8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.793318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a61fc1-4dac-4b40-9c48-5917aacb8cc2 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.795101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 691/1375] 10.222.0.57 () {54 vars in 963 bytes} [Wed Dec 15 12:57:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:06.800852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c741-dbbc-41d2-86a6-afaa48a6bebe None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.801267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c741-dbbc-41d2-86a6-afaa48a6bebe None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.801769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c741-dbbc-41d2-86a6-afaa48a6bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.852452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-03b8c741-dbbc-41d2-86a6-afaa48a6bebe None None] MFA Rules not processed for user `77e852bb87284a4c9bd820d088bcb759`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:06.853651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-03b8c741-dbbc-41d2-86a6-afaa48a6bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:06.920504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 685/1376] 10.222.0.57 () {58 vars in 1060 bytes} [Wed Dec 15 12:57:06 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:06.928654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61fc1-4dac-4b40-9c48-5917aacb8cc2 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:06.939955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a61fc1-4dac-4b40-9c48-5917aacb8cc2 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:06.940142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4426-6065-4e29-b900-17d21dd71127 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.940380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4426-6065-4e29-b900-17d21dd71127 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.940579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4426-6065-4e29-b900-17d21dd71127 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.942615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 686/1377] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:57:06.944167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0bab-73f4-44c4-8b5c-24a1af7a28b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:06.944798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0bab-73f4-44c4-8b5c-24a1af7a28b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.945075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0bab-73f4-44c4-8b5c-24a1af7a28b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.945343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0bab-73f4-44c4-8b5c-24a1af7a28b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.948167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:06.948469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:06.948960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:06.955077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0bab-73f4-44c4-8b5c-24a1af7a28b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:06.956563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc0bab-73f4-44c4-8b5c-24a1af7a28b4 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:06.966735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:06.968124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:06.976190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 687/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:57:06.976511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 692/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:57:07.021857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:07.037897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59f193-5a24-49dc-8dfe-e7c29793bd32 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:07.044032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6ed1f-a9af-443a-b454-96f467267c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:07.044745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6ed1f-a9af-443a-b454-96f467267c7b service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:07.045116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6ed1f-a9af-443a-b454-96f467267c7b service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:07.045463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6ed1f-a9af-443a-b454-96f467267c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:07.055195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6ed1f-a9af-443a-b454-96f467267c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:07.057648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6ed1f-a9af-443a-b454-96f467267c7b service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:07.070192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 688/1380] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:09.477165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ed489-5cfb-468e-a139-62e197963cde None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:09.478031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ed489-5cfb-468e-a139-62e197963cde None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:09.478341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ed489-5cfb-468e-a139-62e197963cde None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:09.481001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 693/1381] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:09.487079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd15ec8-0ef6-41d4-95c4-0525bd4b4cad None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:09.487550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd15ec8-0ef6-41d4-95c4-0525bd4b4cad None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:09.487639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd15ec8-0ef6-41d4-95c4-0525bd4b4cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:09.505707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ccd15ec8-0ef6-41d4-95c4-0525bd4b4cad None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:09.506938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ccd15ec8-0ef6-41d4-95c4-0525bd4b4cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:09.514730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 689/1382] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:09.561393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ed489-5cfb-468e-a139-62e197963cde None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:09.575857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ed489-5cfb-468e-a139-62e197963cde None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:09.581206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cc25b-0602-4e99-85e1-c2afdee293d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:09.581829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc25b-0602-4e99-85e1-c2afdee293d2 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:09.582109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc25b-0602-4e99-85e1-c2afdee293d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:09.582411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc25b-0602-4e99-85e1-c2afdee293d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:09.590845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cc25b-0602-4e99-85e1-c2afdee293d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:09.592414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cc25b-0602-4e99-85e1-c2afdee293d2 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:09.601672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 694/1383] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:11.975830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2d60a-0144-4b93-a585-d8ff902ec5cb None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:11.976339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2d60a-0144-4b93-a585-d8ff902ec5cb None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:11.976339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2d60a-0144-4b93-a585-d8ff902ec5cb None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:11.978176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 690/1384] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:11.983771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895c4e-4f6d-46ad-8457-41704fe1d59d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:11.984203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895c4e-4f6d-46ad-8457-41704fe1d59d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:11.984321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb895c4e-4f6d-46ad-8457-41704fe1d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:12.002079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-eb895c4e-4f6d-46ad-8457-41704fe1d59d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:12.003274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-eb895c4e-4f6d-46ad-8457-41704fe1d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:12.012513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 695/1385] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:57:12.058902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2d60a-0144-4b93-a585-d8ff902ec5cb None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:12.073740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2d60a-0144-4b93-a585-d8ff902ec5cb None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:12.079364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119ea01-51bb-4eed-8118-4bc90c9f2b61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:12.080134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119ea01-51bb-4eed-8118-4bc90c9f2b61 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:12.080417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119ea01-51bb-4eed-8118-4bc90c9f2b61 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:12.080689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119ea01-51bb-4eed-8118-4bc90c9f2b61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:12.090000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119ea01-51bb-4eed-8118-4bc90c9f2b61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:12.091599 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119ea01-51bb-4eed-8118-4bc90c9f2b61 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:12.101632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 691/1386] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:14.522985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846565-24af-4e71-ba55-55b728890a08 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:14.523542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846565-24af-4e71-ba55-55b728890a08 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:14.523542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6846565-24af-4e71-ba55-55b728890a08 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:14.526124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 696/1387] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:14.531994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d91f-07f8-44ba-9fd4-f4acfc4d4beb None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:14.532488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d91f-07f8-44ba-9fd4-f4acfc4d4beb None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:14.532584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4d91f-07f8-44ba-9fd4-f4acfc4d4beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:14.550243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-dee4d91f-07f8-44ba-9fd4-f4acfc4d4beb None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:14.551462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-dee4d91f-07f8-44ba-9fd4-f4acfc4d4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:14.559302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 692/1388] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:57:14.603197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846565-24af-4e71-ba55-55b728890a08 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:14.617079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6846565-24af-4e71-ba55-55b728890a08 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:14.622930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df761a79-bf08-4f5b-9179-f54ee3747982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:14.623557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761a79-bf08-4f5b-9179-f54ee3747982 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:14.623897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761a79-bf08-4f5b-9179-f54ee3747982 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:14.624095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df761a79-bf08-4f5b-9179-f54ee3747982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:14.632375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761a79-bf08-4f5b-9179-f54ee3747982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:14.633943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df761a79-bf08-4f5b-9179-f54ee3747982 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:14.643625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 697/1389] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:57:16.986177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2bda5-4795-4759-860c-cb55381ab65d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:16.986724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2bda5-4795-4759-860c-cb55381ab65d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:16.986724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2bda5-4795-4759-860c-cb55381ab65d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:16.988932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 693/1390] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:16.995138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973cfa-6389-4c8c-865e-6d0f8996d968 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:16.995686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973cfa-6389-4c8c-865e-6d0f8996d968 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:16.995686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48973cfa-6389-4c8c-865e-6d0f8996d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:17.013798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-48973cfa-6389-4c8c-865e-6d0f8996d968 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:17.015013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-48973cfa-6389-4c8c-865e-6d0f8996d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:17.029198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 698/1391] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:57:17.076452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2bda5-4795-4759-860c-cb55381ab65d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:17.091037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2bda5-4795-4759-860c-cb55381ab65d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:17.097833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921a97b-e169-49ac-bd99-f72cc043de3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:17.098744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a97b-e169-49ac-bd99-f72cc043de3a service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:17.099126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a97b-e169-49ac-bd99-f72cc043de3a service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:17.099787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921a97b-e169-49ac-bd99-f72cc043de3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:17.111215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921a97b-e169-49ac-bd99-f72cc043de3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:17.112892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921a97b-e169-49ac-bd99-f72cc043de3a service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:17.122581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 694/1392] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:20.106588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940759-6730-4bfa-9f66-30dad198a5f2 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:20.107093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940759-6730-4bfa-9f66-30dad198a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:20.107395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25940759-6730-4bfa-9f66-30dad198a5f2 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:20.110307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 699/1393] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:20.117573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbb9d0-4f52-42d9-ba00-37b8dcef4d16 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:20.118022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbb9d0-4f52-42d9-ba00-37b8dcef4d16 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:20.118860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbb9d0-4f52-42d9-ba00-37b8dcef4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:20.136764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4ffbb9d0-4f52-42d9-ba00-37b8dcef4d16 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:20.137946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4ffbb9d0-4f52-42d9-ba00-37b8dcef4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:20.146212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 695/1394] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:20.191934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940759-6730-4bfa-9f66-30dad198a5f2 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:20.206430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25940759-6730-4bfa-9f66-30dad198a5f2 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:20.211896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4eba84-7b8e-4851-89ee-86456dc37371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:20.212567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eba84-7b8e-4851-89ee-86456dc37371 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:20.212843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eba84-7b8e-4851-89ee-86456dc37371 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:20.213113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eba84-7b8e-4851-89ee-86456dc37371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:20.221214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4eba84-7b8e-4851-89ee-86456dc37371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:20.222841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4eba84-7b8e-4851-89ee-86456dc37371 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:20.232660 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 700/1395] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:22.077865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f4a5-382c-42b2-9a7d-e5de046a1517 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.078457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f4a5-382c-42b2-9a7d-e5de046a1517 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.078457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547f4a5-382c-42b2-9a7d-e5de046a1517 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.080186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 696/1396] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:22.085844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091739f-2702-4e19-80ac-79956745a6c2 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.086312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091739f-2702-4e19-80ac-79956745a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.086538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091739f-2702-4e19-80ac-79956745a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.104592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8091739f-2702-4e19-80ac-79956745a6c2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:22.105778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8091739f-2702-4e19-80ac-79956745a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:22.113572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 701/1397] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:22.171463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f31aa-04ee-43b3-ab1e-3e18f79470ca None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.171750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f31aa-04ee-43b3-ab1e-3e18f79470ca None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.172028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f31aa-04ee-43b3-ab1e-3e18f79470ca None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.173881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 697/1398] 10.222.0.57 () {54 vars in 962 bytes} [Wed Dec 15 12:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:57:22.180257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a78b7-2690-4c06-a5f0-53c187e80d7e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.180575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a78b7-2690-4c06-a5f0-53c187e80d7e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.180822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a78b7-2690-4c06-a5f0-53c187e80d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.233459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b30a78b7-2690-4c06-a5f0-53c187e80d7e None None] MFA Rules not processed for user `bb7c470fd2684be89d1821f2abb36406`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:22.234701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b30a78b7-2690-4c06-a5f0-53c187e80d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:22.293806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 702/1399] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Dec 15 12:57:22 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:22.302362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f31aa-04ee-43b3-ab1e-3e18f79470ca None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:22.314217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f31aa-04ee-43b3-ab1e-3e18f79470ca None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:22.317807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913918e0-7ce5-4e3c-87e7-7fde9cf421f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:22.318569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913918e0-7ce5-4e3c-87e7-7fde9cf421f8 service glance] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.318939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913918e0-7ce5-4e3c-87e7-7fde9cf421f8 service glance] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.319300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913918e0-7ce5-4e3c-87e7-7fde9cf421f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.331735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913918e0-7ce5-4e3c-87e7-7fde9cf421f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:22.331735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913918e0-7ce5-4e3c-87e7-7fde9cf421f8 service glance] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:22.342338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 698/1400] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:57:22.584188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0d91e-93a8-44eb-8933-8de94ecd6b17 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.584391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0d91e-93a8-44eb-8933-8de94ecd6b17 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.584654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0d91e-93a8-44eb-8933-8de94ecd6b17 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.586475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 703/1401] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:22.592440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18779c-d0b5-4fd1-b476-34b6b711ce6d None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.592725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18779c-d0b5-4fd1-b476-34b6b711ce6d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.593000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18779c-d0b5-4fd1-b476-34b6b711ce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.612966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-be18779c-d0b5-4fd1-b476-34b6b711ce6d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:22.614187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-be18779c-d0b5-4fd1-b476-34b6b711ce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:22.622787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 699/1402] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:22.668740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0d91e-93a8-44eb-8933-8de94ecd6b17 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:22.683119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0d91e-93a8-44eb-8933-8de94ecd6b17 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:22.688415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543f214-fc07-4468-b227-2c3d5d4a42ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:22.689032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f214-fc07-4468-b227-2c3d5d4a42ab service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.689309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f214-fc07-4468-b227-2c3d5d4a42ab service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.689576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543f214-fc07-4468-b227-2c3d5d4a42ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.697713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543f214-fc07-4468-b227-2c3d5d4a42ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:22.699319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543f214-fc07-4468-b227-2c3d5d4a42ab service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:22.708499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 704/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:22.786652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b00c-e4d4-40ec-849e-238f6f539d2f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.786943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b00c-e4d4-40ec-849e-238f6f539d2f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.787218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b00c-e4d4-40ec-849e-238f6f539d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.849138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-1009b00c-e4d4-40ec-849e-238f6f539d2f None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:22.850304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1009b00c-e4d4-40ec-849e-238f6f539d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:22.917055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 700/1404] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 12:57:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:22.964132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5c446-29aa-43e9-8e45-2a8ebe371a85 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.964414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5c446-29aa-43e9-8e45-2a8ebe371a85 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.964686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5c446-29aa-43e9-8e45-2a8ebe371a85 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:22.966522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 705/1405] 10.222.0.57 () {54 vars in 942 bytes} [Wed Dec 15 12:57:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:22.974382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c446b3-81c6-4dc7-b91d-ccfdcf82fe35 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:22.974744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c446b3-81c6-4dc7-b91d-ccfdcf82fe35 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:22.975144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c446b3-81c6-4dc7-b91d-ccfdcf82fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:23.022206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-09c446b3-81c6-4dc7-b91d-ccfdcf82fe35 None None] MFA Rules not processed for user `9eca15cf4b614f908d1e47baecadf6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:23.023411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-09c446b3-81c6-4dc7-b91d-ccfdcf82fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:23.091364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 701/1406] 10.222.0.57 () {58 vars in 1039 bytes} [Wed Dec 15 12:57:22 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:23.100982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5c446-29aa-43e9-8e45-2a8ebe371a85 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:23.114654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5c446-29aa-43e9-8e45-2a8ebe371a85 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:23.119447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16600eb4-9006-4563-ab7e-a5c5520d752e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:23.120071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16600eb4-9006-4563-ab7e-a5c5520d752e service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:23.120346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16600eb4-9006-4563-ab7e-a5c5520d752e service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:23.120614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16600eb4-9006-4563-ab7e-a5c5520d752e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:23.128488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16600eb4-9006-4563-ab7e-a5c5520d752e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:23.130041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16600eb4-9006-4563-ab7e-a5c5520d752e service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:23.137863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 706/1407] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 12:57:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 12:57:25.112679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c594c-c128-44fb-a073-f216911896e6 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:25.113255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c594c-c128-44fb-a073-f216911896e6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:25.113255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c594c-c128-44fb-a073-f216911896e6 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:25.115174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 702/1408] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:25.121325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe43f-096a-4d79-a991-6cf0ae966b4a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:25.121800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe43f-096a-4d79-a991-6cf0ae966b4a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:25.122211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffe43f-096a-4d79-a991-6cf0ae966b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:25.141714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-deffe43f-096a-4d79-a991-6cf0ae966b4a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:25.143919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-deffe43f-096a-4d79-a991-6cf0ae966b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:25.151575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 707/1409] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:25.198749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c594c-c128-44fb-a073-f216911896e6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:25.215122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c594c-c128-44fb-a073-f216911896e6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:25.270560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06fdc-5381-4484-86c1-1adf1c843a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:25.271549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06fdc-5381-4484-86c1-1adf1c843a00 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:25.272042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06fdc-5381-4484-86c1-1adf1c843a00 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:25.273074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06fdc-5381-4484-86c1-1adf1c843a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:25.299497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d06fdc-5381-4484-86c1-1adf1c843a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:25.307451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d06fdc-5381-4484-86c1-1adf1c843a00 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:25.319551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 703/1410] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:27.828387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb183f-5e6a-4f04-b118-e54956b383c8 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:27.828933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb183f-5e6a-4f04-b118-e54956b383c8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:27.829376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb183f-5e6a-4f04-b118-e54956b383c8 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:27.831589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 708/1411] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:57:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:27.837813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fcbf1-8f72-4584-b664-a5d989b66031 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:27.838271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fcbf1-8f72-4584-b664-a5d989b66031 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:27.838376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fcbf1-8f72-4584-b664-a5d989b66031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:27.855941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-342fcbf1-8f72-4584-b664-a5d989b66031 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:27.857298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-342fcbf1-8f72-4584-b664-a5d989b66031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:27.870385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 704/1412] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:57:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:27.917463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb183f-5e6a-4f04-b118-e54956b383c8 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:27.933828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb183f-5e6a-4f04-b118-e54956b383c8 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:27.939362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c863-6231-449e-9d7f-3cad3bd2b2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:27.940058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c863-6231-449e-9d7f-3cad3bd2b2ea service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:27.940401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c863-6231-449e-9d7f-3cad3bd2b2ea service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:27.940737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c863-6231-449e-9d7f-3cad3bd2b2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:27.949605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926c863-6231-449e-9d7f-3cad3bd2b2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:27.951258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926c863-6231-449e-9d7f-3cad3bd2b2ea service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:27.960668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 709/1413] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:45.854162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74001fe-d485-4aa4-8649-5246d23239c1 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:45.854720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74001fe-d485-4aa4-8649-5246d23239c1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:45.854720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74001fe-d485-4aa4-8649-5246d23239c1 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:45.856467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 705/1414] 10.222.0.57 () {54 vars in 918 bytes} [Wed Dec 15 12:57:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:45.862228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef25f-8580-430e-84af-16f004f9fce8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:45.862631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef25f-8580-430e-84af-16f004f9fce8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:45.862769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef25f-8580-430e-84af-16f004f9fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:45.880949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-747ef25f-8580-430e-84af-16f004f9fce8 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:45.882118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-747ef25f-8580-430e-84af-16f004f9fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:45.891009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 710/1415] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Dec 15 12:57:45 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:45.906247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ce257-6955-4ae4-97fd-69dfea6e2418 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:45.906554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ce257-6955-4ae4-97fd-69dfea6e2418 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:45.906831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ce257-6955-4ae4-97fd-69dfea6e2418 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:45.908631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 706/1416] 10.222.0.57 () {54 vars in 918 bytes} [Wed Dec 15 12:57:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:45.913638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72855174-4a58-48f5-9b7b-c3c447d0fd67 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:45.913923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72855174-4a58-48f5-9b7b-c3c447d0fd67 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:45.914234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72855174-4a58-48f5-9b7b-c3c447d0fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:45.932822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-72855174-4a58-48f5-9b7b-c3c447d0fd67 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:45.933998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-72855174-4a58-48f5-9b7b-c3c447d0fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:45.943002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 711/1417] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Dec 15 12:57:45 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:48.659640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9ba35-751c-46d5-a204-fd5229b2b22a None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:48.660207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9ba35-751c-46d5-a204-fd5229b2b22a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:48.660207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9ba35-751c-46d5-a204-fd5229b2b22a None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:48.661947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 707/1418] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:57:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:48.668320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62639a-5b82-4375-a1ef-49a220053799 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:48.668750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62639a-5b82-4375-a1ef-49a220053799 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:48.668849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62639a-5b82-4375-a1ef-49a220053799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:48.685998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-fe62639a-5b82-4375-a1ef-49a220053799 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:48.687193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-fe62639a-5b82-4375-a1ef-49a220053799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:48.694704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 712/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:57:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:48.738567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9ba35-751c-46d5-a204-fd5229b2b22a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:48.752437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9ba35-751c-46d5-a204-fd5229b2b22a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:48.757770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee65d6-7b4c-49d7-87a4-43a328caf55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:48.758421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee65d6-7b4c-49d7-87a4-43a328caf55e service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:48.758704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee65d6-7b4c-49d7-87a4-43a328caf55e service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:48.759476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee65d6-7b4c-49d7-87a4-43a328caf55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:48.767584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee65d6-7b4c-49d7-87a4-43a328caf55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:48.769139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee65d6-7b4c-49d7-87a4-43a328caf55e service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:48.779116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 708/1420] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:50.332645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037de75-b730-4efc-83ef-993a143a24ee None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:50.333188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037de75-b730-4efc-83ef-993a143a24ee None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:50.333188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037de75-b730-4efc-83ef-993a143a24ee None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:50.334969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 713/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:57:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:50.340951 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02781c3-508b-4661-bb5c-800c4d626d6e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:50.341380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02781c3-508b-4661-bb5c-800c4d626d6e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:50.341494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02781c3-508b-4661-bb5c-800c4d626d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:50.358913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c02781c3-508b-4661-bb5c-800c4d626d6e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:50.360092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c02781c3-508b-4661-bb5c-800c4d626d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:50.367661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 709/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:50.517612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037de75-b730-4efc-83ef-993a143a24ee None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:50.532543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037de75-b730-4efc-83ef-993a143a24ee None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:50.537861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7eaa2-e543-4ce5-84ec-67b4534ef6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:50.538520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7eaa2-e543-4ce5-84ec-67b4534ef6f8 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:50.538801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7eaa2-e543-4ce5-84ec-67b4534ef6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:50.539075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7eaa2-e543-4ce5-84ec-67b4534ef6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:50.546879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7eaa2-e543-4ce5-84ec-67b4534ef6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:50.548436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7eaa2-e543-4ce5-84ec-67b4534ef6f8 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:50.557400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 714/1423] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:52.166702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fefe3a-f73e-41c9-9e9d-fab9f36cb841 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:52.167254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fefe3a-f73e-41c9-9e9d-fab9f36cb841 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:52.167254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fefe3a-f73e-41c9-9e9d-fab9f36cb841 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:52.169039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 710/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:57:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:52.174401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ba86-24ac-4d48-b317-7436259a7f7b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:52.174807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ba86-24ac-4d48-b317-7436259a7f7b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:52.174969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ba86-24ac-4d48-b317-7436259a7f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:52.192881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8492ba86-24ac-4d48-b317-7436259a7f7b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:52.194053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8492ba86-24ac-4d48-b317-7436259a7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:52.202406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 715/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:52.353963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fefe3a-f73e-41c9-9e9d-fab9f36cb841 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:52.367928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fefe3a-f73e-41c9-9e9d-fab9f36cb841 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:52.373924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadfa32-e64d-4644-9889-70eec5c38cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:52.374588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadfa32-e64d-4644-9889-70eec5c38cd6 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:52.374870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadfa32-e64d-4644-9889-70eec5c38cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:52.375145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadfa32-e64d-4644-9889-70eec5c38cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:52.383075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadfa32-e64d-4644-9889-70eec5c38cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:52.385325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadfa32-e64d-4644-9889-70eec5c38cd6 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:52.394322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 711/1426] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:53.914457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51228fe1-bd60-41fd-8852-958e9477f7e0 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:53.914985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51228fe1-bd60-41fd-8852-958e9477f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:53.914985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51228fe1-bd60-41fd-8852-958e9477f7e0 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:53.917129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 716/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:57:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:53.923083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67919a-cd12-4965-9ff1-2fec43f04fd6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:53.923526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67919a-cd12-4965-9ff1-2fec43f04fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:53.923739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67919a-cd12-4965-9ff1-2fec43f04fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:53.941901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-fa67919a-cd12-4965-9ff1-2fec43f04fd6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:53.943131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fa67919a-cd12-4965-9ff1-2fec43f04fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:53.951570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 712/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:57:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:54.109828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51228fe1-bd60-41fd-8852-958e9477f7e0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:54.124136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51228fe1-bd60-41fd-8852-958e9477f7e0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:54.129361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeef9b-e8bd-4e67-b377-3ebc6fb00a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:54.129984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeef9b-e8bd-4e67-b377-3ebc6fb00a1b service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:54.130301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeef9b-e8bd-4e67-b377-3ebc6fb00a1b service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:54.130577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeef9b-e8bd-4e67-b377-3ebc6fb00a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:54.138516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeef9b-e8bd-4e67-b377-3ebc6fb00a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:54.140083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeef9b-e8bd-4e67-b377-3ebc6fb00a1b service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:54.149106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 717/1429] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:55.674309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef9af4-c9ea-4171-a6eb-93c01cb06adf None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:55.674836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef9af4-c9ea-4171-a6eb-93c01cb06adf None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:55.674930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef9af4-c9ea-4171-a6eb-93c01cb06adf None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:55.676712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 713/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:57:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:55.682056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9c2f-e226-40d7-9f6e-9bfd3510d611 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:55.682546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9c2f-e226-40d7-9f6e-9bfd3510d611 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:55.682643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac9c2f-e226-40d7-9f6e-9bfd3510d611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:55.700616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ffac9c2f-e226-40d7-9f6e-9bfd3510d611 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:55.701784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ffac9c2f-e226-40d7-9f6e-9bfd3510d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:55.709329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 718/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:55.863993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef9af4-c9ea-4171-a6eb-93c01cb06adf None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:55.878404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef9af4-c9ea-4171-a6eb-93c01cb06adf None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:55.883662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6711501-350c-44fd-8888-5dfc593e47cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:55.884836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711501-350c-44fd-8888-5dfc593e47cb service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:55.885113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711501-350c-44fd-8888-5dfc593e47cb service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:55.885387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711501-350c-44fd-8888-5dfc593e47cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:55.893143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6711501-350c-44fd-8888-5dfc593e47cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:55.894746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6711501-350c-44fd-8888-5dfc593e47cb service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:55.904049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 714/1432] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:57.350949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d873-dbd1-40f9-babd-f9994ffc4b24 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:57.351559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d873-dbd1-40f9-babd-f9994ffc4b24 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:57.351559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8d873-dbd1-40f9-babd-f9994ffc4b24 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:57.353808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 719/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:57:57.359311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3762b7-71a1-4bd9-9f3f-4ece2778e9ed None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:57.359749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3762b7-71a1-4bd9-9f3f-4ece2778e9ed None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:57.359855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3762b7-71a1-4bd9-9f3f-4ece2778e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:57.377155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-1d3762b7-71a1-4bd9-9f3f-4ece2778e9ed None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:57.378359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1d3762b7-71a1-4bd9-9f3f-4ece2778e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:57.386029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 715/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:57:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:57.538103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d873-dbd1-40f9-babd-f9994ffc4b24 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:57.552626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8d873-dbd1-40f9-babd-f9994ffc4b24 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:57.557917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986527c-332d-4f84-9e13-c4d799ada175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:57.558576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986527c-332d-4f84-9e13-c4d799ada175 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:57.558856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986527c-332d-4f84-9e13-c4d799ada175 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:57.559133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986527c-332d-4f84-9e13-c4d799ada175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:57.566958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986527c-332d-4f84-9e13-c4d799ada175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:57.568507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986527c-332d-4f84-9e13-c4d799ada175 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:57.577545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 720/1435] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:57:59.023425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f99cc-fe9d-4c91-9ede-b4179918a017 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:59.024039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f99cc-fe9d-4c91-9ede-b4179918a017 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:59.024039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f99cc-fe9d-4c91-9ede-b4179918a017 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:59.026170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 716/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:57:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:57:59.031872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0059b-a204-4573-b77d-fd2e08740de7 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:59.032300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0059b-a204-4573-b77d-fd2e08740de7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:59.032587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0059b-a204-4573-b77d-fd2e08740de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:59.050977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-04c0059b-a204-4573-b77d-fd2e08740de7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:57:59.052158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-04c0059b-a204-4573-b77d-fd2e08740de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:57:59.059774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 721/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:57:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:57:59.209846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f99cc-fe9d-4c91-9ede-b4179918a017 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:57:59.224850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f99cc-fe9d-4c91-9ede-b4179918a017 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:57:59.230424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2818d2-96d1-4d7a-a036-a0c6f944f155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:57:59.231054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2818d2-96d1-4d7a-a036-a0c6f944f155 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:57:59.231334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2818d2-96d1-4d7a-a036-a0c6f944f155 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:57:59.231608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2818d2-96d1-4d7a-a036-a0c6f944f155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:57:59.239765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2818d2-96d1-4d7a-a036-a0c6f944f155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:57:59.241373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2818d2-96d1-4d7a-a036-a0c6f944f155 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:57:59.250422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 717/1438] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:57:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:00.752381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e496a-7492-47a8-8d06-79e7e6209899 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:00.752950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e496a-7492-47a8-8d06-79e7e6209899 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:00.753069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e496a-7492-47a8-8d06-79e7e6209899 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:00.754836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 722/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:58:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:00.760807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd6324-535d-40bc-8c40-19b87ad07aa8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:00.761262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd6324-535d-40bc-8c40-19b87ad07aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:00.761372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd6324-535d-40bc-8c40-19b87ad07aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:00.779528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2bbd6324-535d-40bc-8c40-19b87ad07aa8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:00.780720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2bbd6324-535d-40bc-8c40-19b87ad07aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:00.788415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 718/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:58:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:00.941168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e496a-7492-47a8-8d06-79e7e6209899 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:00.955559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e496a-7492-47a8-8d06-79e7e6209899 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:00.960871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a615481-ac08-4e16-a86a-60b0b9c581ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:00.961486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a615481-ac08-4e16-a86a-60b0b9c581ae service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:00.961761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a615481-ac08-4e16-a86a-60b0b9c581ae service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:00.962634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a615481-ac08-4e16-a86a-60b0b9c581ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:00.970475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a615481-ac08-4e16-a86a-60b0b9c581ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:00.972035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a615481-ac08-4e16-a86a-60b0b9c581ae service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:00.981297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 723/1441] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:02.443337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116d6e-5716-4d87-bfab-fc353c5f2738 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:02.443906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116d6e-5716-4d87-bfab-fc353c5f2738 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:02.443906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116d6e-5716-4d87-bfab-fc353c5f2738 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:02.445643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 719/1442] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 12:58:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:02.451801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe21c-e56d-4639-93e5-968c89ee1247 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:02.452218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe21c-e56d-4639-93e5-968c89ee1247 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:02.452517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe21c-e56d-4639-93e5-968c89ee1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:02.470722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-f5fbe21c-e56d-4639-93e5-968c89ee1247 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:02.471898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f5fbe21c-e56d-4639-93e5-968c89ee1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:02.479800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 724/1443] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 12:58:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:02.633631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d116d6e-5716-4d87-bfab-fc353c5f2738 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:02.648059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d116d6e-5716-4d87-bfab-fc353c5f2738 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:02.653827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ebe7c-1a38-49cd-a445-3fc8c75892a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:02.654498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ebe7c-1a38-49cd-a445-3fc8c75892a0 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:02.654899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ebe7c-1a38-49cd-a445-3fc8c75892a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:02.655205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ebe7c-1a38-49cd-a445-3fc8c75892a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:02.663191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ebe7c-1a38-49cd-a445-3fc8c75892a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:02.664795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ebe7c-1a38-49cd-a445-3fc8c75892a0 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:02.673837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 720/1444] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:04.941612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d15ff-b41c-43b3-b6a7-e90b363a4523 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:04.942215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d15ff-b41c-43b3-b6a7-e90b363a4523 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:04.942215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d15ff-b41c-43b3-b6a7-e90b363a4523 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:04.944021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 725/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:04.950064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f366d2-0142-4583-a1de-adf9626ebb85 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:04.950519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f366d2-0142-4583-a1de-adf9626ebb85 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:04.950668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f366d2-0142-4583-a1de-adf9626ebb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:04.969015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-35f366d2-0142-4583-a1de-adf9626ebb85 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:04.970219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-35f366d2-0142-4583-a1de-adf9626ebb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:04.978504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 721/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:05.016527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d15ff-b41c-43b3-b6a7-e90b363a4523 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:05.027598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d15ff-b41c-43b3-b6a7-e90b363a4523 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:05.031045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14d5c2-b74f-4d39-9e67-775a79cdc3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:05.031663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14d5c2-b74f-4d39-9e67-775a79cdc3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:05.031940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14d5c2-b74f-4d39-9e67-775a79cdc3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:05.032214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14d5c2-b74f-4d39-9e67-775a79cdc3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:05.041736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14d5c2-b74f-4d39-9e67-775a79cdc3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:05.043238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14d5c2-b74f-4d39-9e67-775a79cdc3f5 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:05.052394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 726/1447] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:07.604323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828179d-ae49-4395-89ce-04d5475de8ec None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:07.604881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828179d-ae49-4395-89ce-04d5475de8ec None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:07.604881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828179d-ae49-4395-89ce-04d5475de8ec None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:07.606793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 722/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:07.612596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e4b9-55a2-4103-a5e2-b50450ae819d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:07.613028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e4b9-55a2-4103-a5e2-b50450ae819d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:07.613152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e4b9-55a2-4103-a5e2-b50450ae819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:07.630447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3922e4b9-55a2-4103-a5e2-b50450ae819d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:07.631622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3922e4b9-55a2-4103-a5e2-b50450ae819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:07.639844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 727/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:07.679320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828179d-ae49-4395-89ce-04d5475de8ec None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:07.689487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828179d-ae49-4395-89ce-04d5475de8ec None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:07.692941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979d3e-4970-4330-9fca-500d2fd17536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:07.693739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979d3e-4970-4330-9fca-500d2fd17536 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:07.694019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979d3e-4970-4330-9fca-500d2fd17536 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:07.694323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979d3e-4970-4330-9fca-500d2fd17536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:07.703291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979d3e-4970-4330-9fca-500d2fd17536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:07.704693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979d3e-4970-4330-9fca-500d2fd17536 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:07.714297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 723/1450] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:10.378857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cec4fa-6558-4994-bd31-5b3c35eaf40f None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:10.379399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cec4fa-6558-4994-bd31-5b3c35eaf40f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:10.379399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cec4fa-6558-4994-bd31-5b3c35eaf40f None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:10.381173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 728/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:10.387125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00884c3-62f4-4e45-9b5d-49ba34fbc71a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:10.387570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00884c3-62f4-4e45-9b5d-49ba34fbc71a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:10.387675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00884c3-62f4-4e45-9b5d-49ba34fbc71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:10.405767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b00884c3-62f4-4e45-9b5d-49ba34fbc71a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:10.407005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b00884c3-62f4-4e45-9b5d-49ba34fbc71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:10.414678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 724/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:58:10.454945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cec4fa-6558-4994-bd31-5b3c35eaf40f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:10.465411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cec4fa-6558-4994-bd31-5b3c35eaf40f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:10.468973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cee745-5d86-4234-af20-519689140214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:10.469592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cee745-5d86-4234-af20-519689140214 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:10.469874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cee745-5d86-4234-af20-519689140214 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:10.470167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cee745-5d86-4234-af20-519689140214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:10.479652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cee745-5d86-4234-af20-519689140214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:10.481075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cee745-5d86-4234-af20-519689140214 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:10.490126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 729/1453] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:12.919755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f360a5-cac7-416c-a644-188bdd52d090 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:12.920319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f360a5-cac7-416c-a644-188bdd52d090 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:12.920319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f360a5-cac7-416c-a644-188bdd52d090 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:12.922044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 725/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:12.928160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed049d4-5c21-458d-812f-30246f87c12b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:12.928538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed049d4-5c21-458d-812f-30246f87c12b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:12.928714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed049d4-5c21-458d-812f-30246f87c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:12.947202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8ed049d4-5c21-458d-812f-30246f87c12b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:12.948372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8ed049d4-5c21-458d-812f-30246f87c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:12.956046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 730/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:12.996366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f360a5-cac7-416c-a644-188bdd52d090 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:13.006693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f360a5-cac7-416c-a644-188bdd52d090 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:13.010110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd437d85-7478-4bcf-868a-d8a5d9bf0afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:13.010751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd437d85-7478-4bcf-868a-d8a5d9bf0afd service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:13.011029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd437d85-7478-4bcf-868a-d8a5d9bf0afd service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:13.011298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd437d85-7478-4bcf-868a-d8a5d9bf0afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:13.019802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd437d85-7478-4bcf-868a-d8a5d9bf0afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:13.021210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd437d85-7478-4bcf-868a-d8a5d9bf0afd service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:13.030496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 726/1456] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:15.399128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c320f56-50b9-4b27-8e95-3644f93f6ec6 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:15.399611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c320f56-50b9-4b27-8e95-3644f93f6ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:15.399733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c320f56-50b9-4b27-8e95-3644f93f6ec6 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:15.401937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 731/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:15.407838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd79f-62d6-420e-add9-c2abde814bed None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:15.408268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd79f-62d6-420e-add9-c2abde814bed None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:15.408363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd79f-62d6-420e-add9-c2abde814bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:15.425404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-808fd79f-62d6-420e-add9-c2abde814bed None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:15.426602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-808fd79f-62d6-420e-add9-c2abde814bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:15.434843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 727/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:15.473001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c320f56-50b9-4b27-8e95-3644f93f6ec6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:15.483450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c320f56-50b9-4b27-8e95-3644f93f6ec6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:15.487175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e1cd-c47a-4f0e-89f0-36b8eec23516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:15.487794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e1cd-c47a-4f0e-89f0-36b8eec23516 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:15.488069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e1cd-c47a-4f0e-89f0-36b8eec23516 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:15.488337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e1cd-c47a-4f0e-89f0-36b8eec23516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:15.497314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e1cd-c47a-4f0e-89f0-36b8eec23516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:15.498757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e1cd-c47a-4f0e-89f0-36b8eec23516 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:15.507613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 732/1459] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:17.867253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e065560-a4c4-45c6-acdf-56b8531f4040 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:17.867851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e065560-a4c4-45c6-acdf-56b8531f4040 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:17.867851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e065560-a4c4-45c6-acdf-56b8531f4040 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:17.869627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 728/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:17.875572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5780db-0eba-43c8-baee-d49299e21cf9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:17.875964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5780db-0eba-43c8-baee-d49299e21cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:17.876118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5780db-0eba-43c8-baee-d49299e21cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:17.893927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ac5780db-0eba-43c8-baee-d49299e21cf9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:17.895121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ac5780db-0eba-43c8-baee-d49299e21cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:17.903531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 733/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:17.942961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e065560-a4c4-45c6-acdf-56b8531f4040 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:17.953896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e065560-a4c4-45c6-acdf-56b8531f4040 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:17.957380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22868d00-534a-4e14-99ea-bd068f1d56c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:17.957998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22868d00-534a-4e14-99ea-bd068f1d56c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:17.958313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22868d00-534a-4e14-99ea-bd068f1d56c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:17.958583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22868d00-534a-4e14-99ea-bd068f1d56c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:17.968004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22868d00-534a-4e14-99ea-bd068f1d56c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:17.969413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22868d00-534a-4e14-99ea-bd068f1d56c6 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:17.978535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 729/1462] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:20.371985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf159c-209d-4604-bd15-2f1236634dd1 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:20.372574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf159c-209d-4604-bd15-2f1236634dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:20.372574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf159c-209d-4604-bd15-2f1236634dd1 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:20.374344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 734/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:20.380258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b63f3-6f99-43f8-b1ca-92b5ee40ff44 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:20.380716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b63f3-6f99-43f8-b1ca-92b5ee40ff44 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:20.380855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b63f3-6f99-43f8-b1ca-92b5ee40ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:20.398162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b50b63f3-6f99-43f8-b1ca-92b5ee40ff44 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:20.399382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b50b63f3-6f99-43f8-b1ca-92b5ee40ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:20.407236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 730/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:20.448213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf159c-209d-4604-bd15-2f1236634dd1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:20.458498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf159c-209d-4604-bd15-2f1236634dd1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:20.461908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7602-e1d3-4cc7-a146-b12d47d0a9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:20.462556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7602-e1d3-4cc7-a146-b12d47d0a9dc service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:20.462831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7602-e1d3-4cc7-a146-b12d47d0a9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:20.463100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7602-e1d3-4cc7-a146-b12d47d0a9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:20.471596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d7602-e1d3-4cc7-a146-b12d47d0a9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:20.472995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d7602-e1d3-4cc7-a146-b12d47d0a9dc service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:20.482440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 735/1465] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:22.886796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd88cf3-2b7d-4e46-8da1-a03743f51abf None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:22.887314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd88cf3-2b7d-4e46-8da1-a03743f51abf None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:22.887314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd88cf3-2b7d-4e46-8da1-a03743f51abf None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:22.889080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 731/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:22.894928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5102-a043-4ec6-8e38-1ae46fa5cc04 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:22.895350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5102-a043-4ec6-8e38-1ae46fa5cc04 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:22.895467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5102-a043-4ec6-8e38-1ae46fa5cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:22.912856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-38fe5102-a043-4ec6-8e38-1ae46fa5cc04 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:22.914022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-38fe5102-a043-4ec6-8e38-1ae46fa5cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:22.921550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 736/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:22.960184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd88cf3-2b7d-4e46-8da1-a03743f51abf None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:22.970583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd88cf3-2b7d-4e46-8da1-a03743f51abf None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:22.974005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9ebc3-1cb9-4a9b-9387-42e78a2c9ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:22.974653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ebc3-1cb9-4a9b-9387-42e78a2c9ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:22.974929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ebc3-1cb9-4a9b-9387-42e78a2c9ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:22.975199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9ebc3-1cb9-4a9b-9387-42e78a2c9ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:22.983686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9ebc3-1cb9-4a9b-9387-42e78a2c9ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:22.985094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9ebc3-1cb9-4a9b-9387-42e78a2c9ee0 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:22.994560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 732/1468] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:25.334927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704059fe-da85-4741-a4c8-330a978a2963 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:25.335515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704059fe-da85-4741-a4c8-330a978a2963 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:25.335515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704059fe-da85-4741-a4c8-330a978a2963 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:25.337770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 737/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:25.343581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a341e-f97c-4acd-a36b-a32b3c59354b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:25.344037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a341e-f97c-4acd-a36b-a32b3c59354b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:25.344145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a341e-f97c-4acd-a36b-a32b3c59354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:25.362019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a36a341e-f97c-4acd-a36b-a32b3c59354b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:25.363223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a36a341e-f97c-4acd-a36b-a32b3c59354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:25.370757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 733/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:25.408190 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704059fe-da85-4741-a4c8-330a978a2963 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:25.419334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704059fe-da85-4741-a4c8-330a978a2963 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:25.422842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f034bfa-a57c-4488-8910-15090c8f7901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:25.423459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034bfa-a57c-4488-8910-15090c8f7901 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:25.423737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034bfa-a57c-4488-8910-15090c8f7901 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:25.424009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f034bfa-a57c-4488-8910-15090c8f7901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:25.433075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f034bfa-a57c-4488-8910-15090c8f7901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:25.434513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f034bfa-a57c-4488-8910-15090c8f7901 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:25.443477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 738/1471] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:27.794006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478940-d753-44e0-b313-cb29446ae83a None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:27.794539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478940-d753-44e0-b313-cb29446ae83a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:27.794684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478940-d753-44e0-b313-cb29446ae83a None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:27.796648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 734/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 12:58:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:27.802620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a286-2a71-4208-8fef-209cb6705cc0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:27.803077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a286-2a71-4208-8fef-209cb6705cc0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:27.803163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a286-2a71-4208-8fef-209cb6705cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:27.821296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8ae5a286-2a71-4208-8fef-209cb6705cc0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:27.822529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8ae5a286-2a71-4208-8fef-209cb6705cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:27.830315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 739/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 12:58:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:27.869737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478940-d753-44e0-b313-cb29446ae83a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:27.871457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-65478940-d753-44e0-b313-cb29446ae83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:27.887327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478940-d753-44e0-b313-cb29446ae83a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:27.890794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076a3ae-4797-4293-b28a-c59ff4787781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:27.891419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a3ae-4797-4293-b28a-c59ff4787781 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:27.891697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a3ae-4797-4293-b28a-c59ff4787781 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:27.891990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076a3ae-4797-4293-b28a-c59ff4787781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:27.901526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a3ae-4797-4293-b28a-c59ff4787781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:27.902959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076a3ae-4797-4293-b28a-c59ff4787781 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:27.912561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 735/1474] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:45.068070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8c34-0faa-413e-9e62-691adbe2406b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:45.068601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8c34-0faa-413e-9e62-691adbe2406b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:45.068601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8c34-0faa-413e-9e62-691adbe2406b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:45.070303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 740/1475] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:58:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:45.076485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008a2d-79e6-44df-9848-0b264acce22b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:45.076970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008a2d-79e6-44df-9848-0b264acce22b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:45.077071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008a2d-79e6-44df-9848-0b264acce22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:45.094897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-48008a2d-79e6-44df-9848-0b264acce22b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:45.096109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-48008a2d-79e6-44df-9848-0b264acce22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:45.103676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 736/1476] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:58:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:45.151318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948a2a-7632-4649-8063-2479cb10aa72 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:45.151598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948a2a-7632-4649-8063-2479cb10aa72 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:45.151867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948a2a-7632-4649-8063-2479cb10aa72 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:45.153584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 741/1477] 10.222.0.57 () {54 vars in 962 bytes} [Wed Dec 15 12:58:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:45.158743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b541ea-7136-471a-b33e-8d92880befa2 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:45.159031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b541ea-7136-471a-b33e-8d92880befa2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:45.159311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b541ea-7136-471a-b33e-8d92880befa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:45.176941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e0b541ea-7136-471a-b33e-8d92880befa2 None None] MFA Rules not processed for user `bb7c470fd2684be89d1821f2abb36406`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:45.178118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e0b541ea-7136-471a-b33e-8d92880befa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:45.184392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 737/1478] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Dec 15 12:58:45 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:45.191717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948a2a-7632-4649-8063-2479cb10aa72 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:45.202519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948a2a-7632-4649-8063-2479cb10aa72 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:45.205977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df70ea-50a4-4d01-b3b7-b481cc4bc113 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:45.206629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df70ea-50a4-4d01-b3b7-b481cc4bc113 service glance] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:45.206910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df70ea-50a4-4d01-b3b7-b481cc4bc113 service glance] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:45.207182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df70ea-50a4-4d01-b3b7-b481cc4bc113 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:45.216396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df70ea-50a4-4d01-b3b7-b481cc4bc113 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:45.217849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df70ea-50a4-4d01-b3b7-b481cc4bc113 service glance] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:45.227698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 742/1479] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 12:58:47.665225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c881-e6d5-4af6-9e8f-aa6a023d1eba None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:47.665753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c881-e6d5-4af6-9e8f-aa6a023d1eba None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:47.665753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c881-e6d5-4af6-9e8f-aa6a023d1eba None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:47.667481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 738/1480] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:58:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:47.673576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c77f6-35de-4215-8ac5-3788155c3b57 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:47.674025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c77f6-35de-4215-8ac5-3788155c3b57 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:47.674132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c77f6-35de-4215-8ac5-3788155c3b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:47.691423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ca0c77f6-35de-4215-8ac5-3788155c3b57 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:47.692601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ca0c77f6-35de-4215-8ac5-3788155c3b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:47.700266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 743/1481] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:58:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:47.723666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c881-e6d5-4af6-9e8f-aa6a023d1eba None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:47.736128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c881-e6d5-4af6-9e8f-aa6a023d1eba None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:47.740466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8874cc-f7c4-4417-869e-ab99677dc152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:47.741092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8874cc-f7c4-4417-869e-ab99677dc152 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:47.741367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8874cc-f7c4-4417-869e-ab99677dc152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:47.741638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8874cc-f7c4-4417-869e-ab99677dc152 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:47.742468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8874cc-f7c4-4417-869e-ab99677dc152 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:47.744465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8874cc-f7c4-4417-869e-ab99677dc152 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:47.763314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 739/1482] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Dec 15 12:58:47 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 12:58:50.140735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d691f4-9821-4eaa-8a1b-54642e710e58 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:50.141284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d691f4-9821-4eaa-8a1b-54642e710e58 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:50.141284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d691f4-9821-4eaa-8a1b-54642e710e58 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:50.143076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 744/1483] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:58:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:50.149126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44be83-d96e-4100-98ed-8ab6c124be38 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:50.149586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44be83-d96e-4100-98ed-8ab6c124be38 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:50.149681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44be83-d96e-4100-98ed-8ab6c124be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:50.170054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ee44be83-d96e-4100-98ed-8ab6c124be38 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:50.171301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ee44be83-d96e-4100-98ed-8ab6c124be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:50.179275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 740/1484] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:58:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:58:50.224059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d691f4-9821-4eaa-8a1b-54642e710e58 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:50.238485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d691f4-9821-4eaa-8a1b-54642e710e58 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:50.244525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13f96-3dd0-4853-8b57-e8e9f37fd267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:50.245151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13f96-3dd0-4853-8b57-e8e9f37fd267 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:50.245431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13f96-3dd0-4853-8b57-e8e9f37fd267 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:50.245709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13f96-3dd0-4853-8b57-e8e9f37fd267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:50.253613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13f96-3dd0-4853-8b57-e8e9f37fd267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:50.255234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13f96-3dd0-4853-8b57-e8e9f37fd267 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:50.264971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 745/1485] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:52.797391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc59f-078f-4b01-812d-ce90100cceed None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:52.797975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc59f-078f-4b01-812d-ce90100cceed None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:52.797975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abc59f-078f-4b01-812d-ce90100cceed None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:52.799715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 741/1486] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:58:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 12:58:52.806897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b4d9-effb-4dd5-9ba7-4bee4221f681 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:52.807365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b4d9-effb-4dd5-9ba7-4bee4221f681 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:52.807499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b4d9-effb-4dd5-9ba7-4bee4221f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:52.826644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e928b4d9-effb-4dd5-9ba7-4bee4221f681 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:52.827850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e928b4d9-effb-4dd5-9ba7-4bee4221f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:52.835703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 746/1487] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:52.874212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc59f-078f-4b01-812d-ce90100cceed None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:52.886444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abc59f-078f-4b01-812d-ce90100cceed None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:52.891075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22366922-5988-4217-b72a-c18f545c7977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:52.891715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366922-5988-4217-b72a-c18f545c7977 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:52.891998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366922-5988-4217-b72a-c18f545c7977 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:52.892303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22366922-5988-4217-b72a-c18f545c7977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:52.902373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22366922-5988-4217-b72a-c18f545c7977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:52.903854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22366922-5988-4217-b72a-c18f545c7977 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:52.916375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 742/1488] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:55.325512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ef07-767e-4496-8383-dfa98a18d492 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:55.326092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ef07-767e-4496-8383-dfa98a18d492 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:55.326092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ef07-767e-4496-8383-dfa98a18d492 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:55.328003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 747/1489] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:58:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:55.333540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bcc43-608b-4bdc-81c1-4f148ab78101 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:55.333956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bcc43-608b-4bdc-81c1-4f148ab78101 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:55.334093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bcc43-608b-4bdc-81c1-4f148ab78101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:55.351668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a26bcc43-608b-4bdc-81c1-4f148ab78101 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:55.352859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a26bcc43-608b-4bdc-81c1-4f148ab78101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:55.360810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 743/1490] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:58:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 12:58:55.401477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ef07-767e-4496-8383-dfa98a18d492 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:55.412579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ef07-767e-4496-8383-dfa98a18d492 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:55.416136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61bb7-2340-4289-9975-ed344a62e925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:55.416781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61bb7-2340-4289-9975-ed344a62e925 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:55.417046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61bb7-2340-4289-9975-ed344a62e925 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:55.417314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61bb7-2340-4289-9975-ed344a62e925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:55.426262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd61bb7-2340-4289-9975-ed344a62e925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:55.427681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd61bb7-2340-4289-9975-ed344a62e925 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:55.437296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 748/1491] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:58:57.975992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6eb0e-b29d-45a6-b6a9-84fae60998f1 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:57.976593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6eb0e-b29d-45a6-b6a9-84fae60998f1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:57.976593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6eb0e-b29d-45a6-b6a9-84fae60998f1 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:57.978965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 744/1492] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:58:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:58:57.984924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b2a1f-c497-4e23-9343-3f5dcaa20725 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:57.985363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b2a1f-c497-4e23-9343-3f5dcaa20725 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:57.985470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b2a1f-c497-4e23-9343-3f5dcaa20725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:58.004101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-066b2a1f-c497-4e23-9343-3f5dcaa20725 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:58:58.005350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-066b2a1f-c497-4e23-9343-3f5dcaa20725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:58:58.013247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 749/1493] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:58:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:58:58.058638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6eb0e-b29d-45a6-b6a9-84fae60998f1 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:58:58.069350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6eb0e-b29d-45a6-b6a9-84fae60998f1 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:58:58.073650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b12836-7d75-4962-a5b5-6c35f4a36c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:58:58.074297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12836-7d75-4962-a5b5-6c35f4a36c51 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:58:58.074575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12836-7d75-4962-a5b5-6c35f4a36c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:58:58.074845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b12836-7d75-4962-a5b5-6c35f4a36c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:58:58.083400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b12836-7d75-4962-a5b5-6c35f4a36c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:58:58.084811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b12836-7d75-4962-a5b5-6c35f4a36c51 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:58:58.094269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 745/1494] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:58:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 12:59:00.696715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3076-dbb1-461c-a0ec-f1a47f770a8b None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:59:00.697252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3076-dbb1-461c-a0ec-f1a47f770a8b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:59:00.697252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3076-dbb1-461c-a0ec-f1a47f770a8b None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:59:00.699038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 750/1495] 10.222.0.57 () {54 vars in 926 bytes} [Wed Dec 15 12:59:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 12:59:00.704823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50016-b7a5-401d-823c-7d1abf6798a6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:59:00.705211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50016-b7a5-401d-823c-7d1abf6798a6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:59:00.705385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db50016-b7a5-401d-823c-7d1abf6798a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:59:00.722782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-3db50016-b7a5-401d-823c-7d1abf6798a6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 12:59:00.723963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3db50016-b7a5-401d-823c-7d1abf6798a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 12:59:00.732336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 746/1496] 10.222.0.57 () {58 vars in 1023 bytes} [Wed Dec 15 12:59:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 12:59:00.772221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3076-dbb1-461c-a0ec-f1a47f770a8b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 12:59:00.782654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3076-dbb1-461c-a0ec-f1a47f770a8b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 12:59:00.786078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca80cd-8fb6-472d-9f9b-4c95dab935d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 12:59:00.786720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca80cd-8fb6-472d-9f9b-4c95dab935d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 12:59:00.786995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca80cd-8fb6-472d-9f9b-4c95dab935d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 12:59:00.787262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca80cd-8fb6-472d-9f9b-4c95dab935d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 12:59:00.796261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca80cd-8fb6-472d-9f9b-4c95dab935d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 12:59:00.797666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca80cd-8fb6-472d-9f9b-4c95dab935d8 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 12:59:00.807224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 751/1497] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 12:59:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:00:28.220231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.220873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.220873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.240408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:00:28.241613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:00:28.249442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 747/1498] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:00:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:00:28.257691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.258292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.258292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.276979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:00:28.278217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:00:28.285963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 752/1499] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:00:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:00:28.291217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.301112 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fcf69-c8d5-4d91-bc93-c374e0e40929 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.306366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.307033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.307312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.307581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.308319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:00:28.308619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.310281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.323011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 748/1500] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:00:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:00:28.331228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.340958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079881d-98cb-4ede-80b7-ec771783e4b4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.346508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.347250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.347532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.347806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.348605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.351359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.389828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 753/1501] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:00:28 2021] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:00:28.394776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.405521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b211b52-e8e4-464a-a150-068d6ee534a8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.469593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.470433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.470854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.471340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.472405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.474386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.494507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 749/1502] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:00:28 2021] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:00:28.498804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.509135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d9291-9eb5-4b23-9cd7-ec360ec1fe97 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.513668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.514354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.514636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.514905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.515637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.517208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.529740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 754/1503] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:00:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:00:28.533665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.543770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25a92-992e-47fe-8ba1-f86e02c30541 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.548266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b92ab-7218-4fc9-b15b-1dca78e33ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.548914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b92ab-7218-4fc9-b15b-1dca78e33ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.549195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b92ab-7218-4fc9-b15b-1dca78e33ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.549467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b92ab-7218-4fc9-b15b-1dca78e33ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.550225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b92ab-7218-4fc9-b15b-1dca78e33ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.552126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b92ab-7218-4fc9-b15b-1dca78e33ec2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.565870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 750/1504] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:00:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:00:28.569945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.579790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ea0cf-7385-432e-a3ff-bebbb2f51a32 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.584311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.585174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.585451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.585719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] PATH_INFO: `/v3/projects/e7f55afa987841f7b98e7fd2c58a40de/users/f9db0b6be4fb49d1a5986f62c37da6e8/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.600511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f55afa987841f7b98e7fd2c58a40de, user_id=f9db0b6be4fb49d1a5986f62c37da6e8, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.603192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.616203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 755/1505] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:00:28 2021] PUT /identity/v3/projects/e7f55afa987841f7b98e7fd2c58a40de/users/f9db0b6be4fb49d1a5986f62c37da6e8/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:00:28.627551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c4b37-5b2e-49f2-8fa7-8a3d71bb7020 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.627835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c4b37-5b2e-49f2-8fa7-8a3d71bb7020 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.628107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c4b37-5b2e-49f2-8fa7-8a3d71bb7020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.654241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e01c4b37-5b2e-49f2-8fa7-8a3d71bb7020 None None] MFA Rules not processed for user `f9db0b6be4fb49d1a5986f62c37da6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:00:28.655453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e01c4b37-5b2e-49f2-8fa7-8a3d71bb7020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:00:28.718078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 751/1506] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:00:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:00:28.731413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.800971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f311c5f-141b-4ce9-8dee-ea2537a39f76 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.808856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.809512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.809794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.810070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.818508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.820098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:28.829420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 756/1507] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:00:28 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:00:28.897947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409953c9-e8f4-4cee-ab2a-3c538e905d8d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.898274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409953c9-e8f4-4cee-ab2a-3c538e905d8d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.898546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409953c9-e8f4-4cee-ab2a-3c538e905d8d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.900259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 752/1508] 10.222.0.57 () {52 vars in 829 bytes} [Wed Dec 15 13:00:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:00:28.904237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:28.963788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168fdb7-0235-4d39-8343-077659c2b544 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:28.968340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:28.969191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:28.969470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:28.969738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] PATH_INFO: `/v3/users/f9db0b6be4fb49d1a5986f62c37da6e8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:28.970949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9db0b6be4fb49d1a5986f62c37da6e8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:28.972071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:00:28.972071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 13:00:28.972071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 13:00:28.973300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:29.045993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9db0b6be4fb49d1a5986f62c37da6e8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.054957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9db0b6be4fb49d1a5986f62c37da6e8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.067271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9db0b6be4fb49d1a5986f62c37da6e8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.086907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9db0b6be4fb49d1a5986f62c37da6e8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.087757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9db0b6be4fb49d1a5986f62c37da6e8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.093574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 757/1509] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:00:28 2021] DELETE /identity/v3/users/f9db0b6be4fb49d1a5986f62c37da6e8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:00:29.098162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:29.098554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:29.098759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:29.116496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:00:29.117700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:00:29.175039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 753/1510] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:00:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:00:29.184880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:29.186348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:00:29.240864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8141ab4-6afc-4d8b-8dac-ed5a2b2a5091 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:29.244409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e12b9-0f72-4e90-8467-6f1eefa777c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:29.245042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e12b9-0f72-4e90-8467-6f1eefa777c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:29.245319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e12b9-0f72-4e90-8467-6f1eefa777c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:29.245590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e12b9-0f72-4e90-8467-6f1eefa777c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:29.254242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e12b9-0f72-4e90-8467-6f1eefa777c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:29.256183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e12b9-0f72-4e90-8467-6f1eefa777c1 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:29.265158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 758/1511] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:00:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:00:29.617287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:00:29.618770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:00:29.634843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41104-e593-421e-9b4e-a1849bb77cf3 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:00:29.639633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:00:29.640704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:00:29.640988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:00:29.641260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] PATH_INFO: `/v3/projects/e7f55afa987841f7b98e7fd2c58a40de` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:00:29.642725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f55afa987841f7b98e7fd2c58a40de)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:00:29.643752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:00:29.643752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 13:00:29.643752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 13:00:29.644948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:00:29.714238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f55afa987841f7b98e7fd2c58a40de', 'request_id': 'req-dcedc080-ba59-4460-bac7-7eda830fb62b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.728824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f55afa987841f7b98e7fd2c58a40de', 'request_id': 'req-dcedc080-ba59-4460-bac7-7eda830fb62b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.740753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f55afa987841f7b98e7fd2c58a40de', 'request_id': 'req-dcedc080-ba59-4460-bac7-7eda830fb62b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.752168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] The token cache is being invalidate because project e7f55afa987841f7b98e7fd2c58a40de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:00:29.752457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.753204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dcedc080-ba59-4460-bac7-7eda830fb62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:00:29.754787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 754/1512] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:00:29 2021] DELETE /identity/v3/projects/e7f55afa987841f7b98e7fd2c58a40de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:02:00.564495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8199e8-5b71-4a69-aaf2-deb9c509b4fa None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:00.565063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8199e8-5b71-4a69-aaf2-deb9c509b4fa None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:00.565063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8199e8-5b71-4a69-aaf2-deb9c509b4fa None None] PATH_INFO: `/v3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:00.566372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 759/1513] 10.222.0.58 () {54 vars in 925 bytes} [Wed Dec 15 13:02:00 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:02:00.574101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d91bb-6835-4f7c-ac40-55e12110e778 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:00.574577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d91bb-6835-4f7c-ac40-55e12110e778 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:00.574689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d91bb-6835-4f7c-ac40-55e12110e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:00.592654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-445d91bb-6835-4f7c-ac40-55e12110e778 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:00.593851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-445d91bb-6835-4f7c-ac40-55e12110e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:00.665697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 755/1514] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Dec 15 13:02:00 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:01.090692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d46c-1a95-43ce-824c-9bd9a0a8c7e7 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:01.090912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d46c-1a95-43ce-824c-9bd9a0a8c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:01.091153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d46c-1a95-43ce-824c-9bd9a0a8c7e7 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:01.092937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 760/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:02:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:01.098317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfcefd-9156-441b-b43a-3cfc351f957c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:01.098608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfcefd-9156-441b-b43a-3cfc351f957c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:01.098885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dfcefd-9156-441b-b43a-3cfc351f957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:01.118274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-f2dfcefd-9156-441b-b43a-3cfc351f957c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:01.119452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f2dfcefd-9156-441b-b43a-3cfc351f957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:01.173370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 756/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:02:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:01.327836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d46c-1a95-43ce-824c-9bd9a0a8c7e7 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:01.329482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b3e7d46c-1a95-43ce-824c-9bd9a0a8c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:01.401094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d46c-1a95-43ce-824c-9bd9a0a8c7e7 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:01.406988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb8ee3-a68f-4551-a33a-c05da60244e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:01.407622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8ee3-a68f-4551-a33a-c05da60244e1 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:01.407900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8ee3-a68f-4551-a33a-c05da60244e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:01.408173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8ee3-a68f-4551-a33a-c05da60244e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:01.416023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb8ee3-a68f-4551-a33a-c05da60244e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:01.417674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb8ee3-a68f-4551-a33a-c05da60244e1 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:01.427676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 761/1517] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:02.916626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79b43c-db1f-4372-9402-c013a9afdc44 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:02.917055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79b43c-db1f-4372-9402-c013a9afdc44 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:02.917179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79b43c-db1f-4372-9402-c013a9afdc44 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:02.919010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 757/1518] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:02:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:02.924303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71089a0b-f867-4f46-8d0e-e5f91d992933 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:02.924754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71089a0b-f867-4f46-8d0e-e5f91d992933 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:02.924870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71089a0b-f867-4f46-8d0e-e5f91d992933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:02.943350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-71089a0b-f867-4f46-8d0e-e5f91d992933 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:02.944524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-71089a0b-f867-4f46-8d0e-e5f91d992933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:02.952081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 762/1519] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:02:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:03.105155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79b43c-db1f-4372-9402-c013a9afdc44 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:03.119432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79b43c-db1f-4372-9402-c013a9afdc44 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:03.125268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add838e-8108-43cf-bd53-24ae1af99cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:03.125879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add838e-8108-43cf-bd53-24ae1af99cd0 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:03.126165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add838e-8108-43cf-bd53-24ae1af99cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:03.126448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add838e-8108-43cf-bd53-24ae1af99cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:03.134164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add838e-8108-43cf-bd53-24ae1af99cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:03.135742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add838e-8108-43cf-bd53-24ae1af99cd0 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:03.144601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 758/1520] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:04.296275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a907-8beb-43c4-92be-19d34e83b722 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:04.296706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a907-8beb-43c4-92be-19d34e83b722 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:04.296810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a907-8beb-43c4-92be-19d34e83b722 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:04.298615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 763/1521] 10.222.0.57 () {54 vars in 960 bytes} [Wed Dec 15 13:02:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:04.304023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fce3a-addf-4052-89a9-bc3dfde9a082 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:04.304417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fce3a-addf-4052-89a9-bc3dfde9a082 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:04.304575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fce3a-addf-4052-89a9-bc3dfde9a082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:04.322590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bc8fce3a-addf-4052-89a9-bc3dfde9a082 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:04.323938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bc8fce3a-addf-4052-89a9-bc3dfde9a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:04.333041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 759/1522] 10.222.0.57 () {58 vars in 1057 bytes} [Wed Dec 15 13:02:04 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:04.340764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a907-8beb-43c4-92be-19d34e83b722 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:04.354090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a907-8beb-43c4-92be-19d34e83b722 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:04.358973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf9e61-d8b4-44ed-9638-a012d9d2fa20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:04.359595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9e61-d8b4-44ed-9638-a012d9d2fa20 service placement] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:04.359874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9e61-d8b4-44ed-9638-a012d9d2fa20 service placement] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:04.360145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9e61-d8b4-44ed-9638-a012d9d2fa20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:04.368235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf9e61-d8b4-44ed-9638-a012d9d2fa20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:04.369827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf9e61-d8b4-44ed-9638-a012d9d2fa20 service placement] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:04.379944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 764/1523] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:15.029408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136de87-9f13-4f1d-a82f-19f5b5806a2d None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:15.029978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136de87-9f13-4f1d-a82f-19f5b5806a2d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:15.029978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136de87-9f13-4f1d-a82f-19f5b5806a2d None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:15.031786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 760/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:02:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:15.037743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0b771-4ed9-4263-bd2c-3c413bc7a11b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:15.038253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0b771-4ed9-4263-bd2c-3c413bc7a11b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:15.038353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0b771-4ed9-4263-bd2c-3c413bc7a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:15.056209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-50b0b771-4ed9-4263-bd2c-3c413bc7a11b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:15.057378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-50b0b771-4ed9-4263-bd2c-3c413bc7a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:15.065010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 765/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:02:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:15.219631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136de87-9f13-4f1d-a82f-19f5b5806a2d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:15.233994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136de87-9f13-4f1d-a82f-19f5b5806a2d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:15.241531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dedc6-a7f3-40d3-b770-9de43d1d1cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:15.242485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dedc6-a7f3-40d3-b770-9de43d1d1cf0 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:15.242862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dedc6-a7f3-40d3-b770-9de43d1d1cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:15.243461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dedc6-a7f3-40d3-b770-9de43d1d1cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:15.252372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dedc6-a7f3-40d3-b770-9de43d1d1cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:15.253929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dedc6-a7f3-40d3-b770-9de43d1d1cf0 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:15.263102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 761/1526] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:16.785177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea435-ff83-4997-8855-f48a3c621993 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:16.785749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea435-ff83-4997-8855-f48a3c621993 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:16.785749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea435-ff83-4997-8855-f48a3c621993 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:16.787504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 766/1527] 127.0.0.1 () {54 vars in 901 bytes} [Wed Dec 15 13:02:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:16.792881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c974-a2ec-4828-a0b4-b0bddeb9b8dd None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:16.793307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c974-a2ec-4828-a0b4-b0bddeb9b8dd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:16.793431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99c974-a2ec-4828-a0b4-b0bddeb9b8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:16.811832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-da99c974-a2ec-4828-a0b4-b0bddeb9b8dd None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:16.813012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-da99c974-a2ec-4828-a0b4-b0bddeb9b8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:16.820600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 762/1528] 127.0.0.1 () {58 vars in 998 bytes} [Wed Dec 15 13:02:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:16.973547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea435-ff83-4997-8855-f48a3c621993 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:16.987512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea435-ff83-4997-8855-f48a3c621993 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:16.992775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365dd32-359d-41f3-ad95-df811615dd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:16.993394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365dd32-359d-41f3-ad95-df811615dd7e service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:16.993675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365dd32-359d-41f3-ad95-df811615dd7e service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:16.993956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365dd32-359d-41f3-ad95-df811615dd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:17.002249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365dd32-359d-41f3-ad95-df811615dd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:17.003833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365dd32-359d-41f3-ad95-df811615dd7e service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:17.012842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 767/1529] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:21.675883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035c9a-909e-41da-b2e5-3d3f1fe16e03 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:21.676442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035c9a-909e-41da-b2e5-3d3f1fe16e03 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:21.676442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035c9a-909e-41da-b2e5-3d3f1fe16e03 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:21.678340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 763/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:02:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:21.683866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14590e0-4ab8-4665-99a9-9d8fcc4aa52e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:21.684306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14590e0-4ab8-4665-99a9-9d8fcc4aa52e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:21.684401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14590e0-4ab8-4665-99a9-9d8fcc4aa52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:21.703020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a14590e0-4ab8-4665-99a9-9d8fcc4aa52e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:21.704326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a14590e0-4ab8-4665-99a9-9d8fcc4aa52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:21.713216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 768/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:02:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:21.749908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035c9a-909e-41da-b2e5-3d3f1fe16e03 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:21.752095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-14035c9a-909e-41da-b2e5-3d3f1fe16e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:21.807714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035c9a-909e-41da-b2e5-3d3f1fe16e03 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:21.811129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a705097-edbe-43d2-ad15-9604e534d248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:21.811768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705097-edbe-43d2-ad15-9604e534d248 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:21.812060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705097-edbe-43d2-ad15-9604e534d248 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:21.812318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a705097-edbe-43d2-ad15-9604e534d248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:21.821700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a705097-edbe-43d2-ad15-9604e534d248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:21.823285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a705097-edbe-43d2-ad15-9604e534d248 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:21.832094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 764/1532] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:24.155962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e854a04-3ca7-4c2d-8e16-dc477afa9d8e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:24.156509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e854a04-3ca7-4c2d-8e16-dc477afa9d8e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:24.156603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e854a04-3ca7-4c2d-8e16-dc477afa9d8e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:24.159002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 769/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:02:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:24.164777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c29ee6-aa93-4eed-8d08-c4b8f535d77c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:24.165199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c29ee6-aa93-4eed-8d08-c4b8f535d77c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:24.165331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c29ee6-aa93-4eed-8d08-c4b8f535d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:24.182779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-64c29ee6-aa93-4eed-8d08-c4b8f535d77c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:24.183993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-64c29ee6-aa93-4eed-8d08-c4b8f535d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:24.191726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 765/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:02:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:24.229175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e854a04-3ca7-4c2d-8e16-dc477afa9d8e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:24.240096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e854a04-3ca7-4c2d-8e16-dc477afa9d8e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:24.243988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d871e-4467-408d-b7de-b15031b71f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:24.244614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d871e-4467-408d-b7de-b15031b71f6a service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:24.244896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d871e-4467-408d-b7de-b15031b71f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:24.245172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d871e-4467-408d-b7de-b15031b71f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:24.253950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d871e-4467-408d-b7de-b15031b71f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:24.255410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d871e-4467-408d-b7de-b15031b71f6a service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:24.264486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 770/1535] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:28.102797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b50f-44d2-40e1-b6f3-98e4a5584c42 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:28.103362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b50f-44d2-40e1-b6f3-98e4a5584c42 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:28.103362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693b50f-44d2-40e1-b6f3-98e4a5584c42 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:28.105083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 766/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:02:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:28.110971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f409-5e5e-4c36-9e67-4c28af5eb65f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:28.111913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f409-5e5e-4c36-9e67-4c28af5eb65f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:28.112197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2f409-5e5e-4c36-9e67-4c28af5eb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:28.130539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-edc2f409-5e5e-4c36-9e67-4c28af5eb65f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:28.131708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-edc2f409-5e5e-4c36-9e67-4c28af5eb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:28.139514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 771/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:02:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:28.190256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b50f-44d2-40e1-b6f3-98e4a5584c42 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:28.191980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-9693b50f-44d2-40e1-b6f3-98e4a5584c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:28.249479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693b50f-44d2-40e1-b6f3-98e4a5584c42 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:28.252968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f48c0-c61d-49a7-8978-b756eb6596f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:28.253600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f48c0-c61d-49a7-8978-b756eb6596f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:28.253877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f48c0-c61d-49a7-8978-b756eb6596f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:28.254179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f48c0-c61d-49a7-8978-b756eb6596f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:28.262703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f48c0-c61d-49a7-8978-b756eb6596f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:28.264115 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f48c0-c61d-49a7-8978-b756eb6596f8 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:28.273099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 767/1538] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:02:30.609242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ce35c-0d71-4694-bcb6-406f55245a7c None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:30.609771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ce35c-0d71-4694-bcb6-406f55245a7c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:30.609771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ce35c-0d71-4694-bcb6-406f55245a7c None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:30.611509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 772/1539] 127.0.0.1 () {54 vars in 916 bytes} [Wed Dec 15 13:02:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:30.617404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbef2a2-6219-4e64-8b45-95af18ea3eca None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:30.617831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbef2a2-6219-4e64-8b45-95af18ea3eca None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:30.617941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbef2a2-6219-4e64-8b45-95af18ea3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:30.636222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ebbef2a2-6219-4e64-8b45-95af18ea3eca None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:30.637420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ebbef2a2-6219-4e64-8b45-95af18ea3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:30.645746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 768/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Dec 15 13:02:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:30.694669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e0978-779f-4ec6-8aac-7bb96641eabb None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:30.694955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e0978-779f-4ec6-8aac-7bb96641eabb None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:30.695256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e0978-779f-4ec6-8aac-7bb96641eabb None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:30.697005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 773/1541] 10.222.0.57 () {54 vars in 963 bytes} [Wed Dec 15 13:02:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:02:30.703094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0304-419a-4d25-a698-c4added6755e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:30.703386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0304-419a-4d25-a698-c4added6755e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:30.703691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0304-419a-4d25-a698-c4added6755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:30.722361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-32dc0304-419a-4d25-a698-c4added6755e None None] MFA Rules not processed for user `77e852bb87284a4c9bd820d088bcb759`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:02:30.723544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-32dc0304-419a-4d25-a698-c4added6755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:02:30.730045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 769/1542] 10.222.0.57 () {58 vars in 1060 bytes} [Wed Dec 15 13:02:30 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:02:30.737720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e0978-779f-4ec6-8aac-7bb96641eabb None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:02:30.747906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e0978-779f-4ec6-8aac-7bb96641eabb None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:02:30.751411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf14258-fd45-43d7-95ac-de08d8f76ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:02:30.752534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14258-fd45-43d7-95ac-de08d8f76ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:02:30.752813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14258-fd45-43d7-95ac-de08d8f76ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:02:30.753085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf14258-fd45-43d7-95ac-de08d8f76ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:02:30.761622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf14258-fd45-43d7-95ac-de08d8f76ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:02:30.763069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf14258-fd45-43d7-95ac-de08d8f76ad0 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:02:30.773309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 774/1543] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:02:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:53.031699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ca93-20b6-415e-b784-44823a9e5ea1 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.032334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ca93-20b6-415e-b784-44823a9e5ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.032334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ca93-20b6-415e-b784-44823a9e5ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.056122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e7d9ca93-20b6-415e-b784-44823a9e5ea1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.058220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e7d9ca93-20b6-415e-b784-44823a9e5ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.062477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976ee6-593d-46e4-a203-fc028b34e769 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.063483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976ee6-593d-46e4-a203-fc028b34e769 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.064012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976ee6-593d-46e4-a203-fc028b34e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.076873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 770/1544] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.097604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e3976ee6-593d-46e4-a203-fc028b34e769 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.098356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.098644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.098919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.099951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e3976ee6-593d-46e4-a203-fc028b34e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.109911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 775/1545] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:03:53.120553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.121608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.122117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.130478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.131979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.149983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 771/1546] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Dec 15 13:03:53.151106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.152327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.157752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.167424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 776/1547] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:03:53.173296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.180464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634b82a-5af5-4409-acb4-b389d2f0328a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.188161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6a01-8c17-4da0-befd-36327bf2948b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.197719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.198497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.198986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.199481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.199612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.199762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.200121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.200242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.200968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:53.201277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.201949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:53.202471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.202928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.204741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.224464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 777/1548] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:53.234553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.242461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 772/1549] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:03:53.250636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaca1e3-5659-4e6b-9a0c-510796aa96e4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.261548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b930c6-127c-4e75-a274-587f013b253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.264047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.264227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b930c6-127c-4e75-a274-587f013b253b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.264227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b930c6-127c-4e75-a274-587f013b253b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.264783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b930c6-127c-4e75-a274-587f013b253b admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.265997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b930c6-127c-4e75-a274-587f013b253b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.268654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b930c6-127c-4e75-a274-587f013b253b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.293899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12fcab-e4e3-4244-96d9-3c1f02c04359 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.310997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 778/1550] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:03:53.312716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.313199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.313731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.330870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.331948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.332240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.332522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.333261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.335761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.348779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.350743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.397069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 773/1551] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:53.397949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.460681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 779/1552] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.461718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.480169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc98a1-1d79-44d1-9fd7-bf31439f4b73 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.530604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41c7f-dc3a-4ca3-ad07-5804d4b27ce5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.543720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f2bb8-34b3-4586-9bf8-f8811558cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.544480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f2bb8-34b3-4586-9bf8-f8811558cab6 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.544719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f2bb8-34b3-4586-9bf8-f8811558cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.544990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f2bb8-34b3-4586-9bf8-f8811558cab6 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.545695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f2bb8-34b3-4586-9bf8-f8811558cab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.547675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f2bb8-34b3-4586-9bf8-f8811558cab6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.589912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 774/1553] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:53.591249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853e8d-a696-446d-8d78-8f7185a6e8da None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.591992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853e8d-a696-446d-8d78-8f7185a6e8da None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.591992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853e8d-a696-446d-8d78-8f7185a6e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.594664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1986f-944a-420d-a9fa-b62945c9b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.595397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1986f-944a-420d-a9fa-b62945c9b407 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.595874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1986f-944a-420d-a9fa-b62945c9b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.595979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1986f-944a-420d-a9fa-b62945c9b407 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.596622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1986f-944a-420d-a9fa-b62945c9b407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.598649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1986f-944a-420d-a9fa-b62945c9b407 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.619793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-83853e8d-a696-446d-8d78-8f7185a6e8da None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.621026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-83853e8d-a696-446d-8d78-8f7185a6e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.623919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 780/1554] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:53.627519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56ea5-effc-4338-aff7-2b62248f6afe None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.627519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56ea5-effc-4338-aff7-2b62248f6afe None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.627519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56ea5-effc-4338-aff7-2b62248f6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.634908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 775/1555] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.636857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.637363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.637847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.646278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6bd56ea5-effc-4338-aff7-2b62248f6afe None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.648081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6bd56ea5-effc-4338-aff7-2b62248f6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.656550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 781/1556] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.657910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4930de-1695-499b-af2e-1771d31472c6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.658228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4930de-1695-499b-af2e-1771d31472c6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.658786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4930de-1695-499b-af2e-1771d31472c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.664876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.666096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.674240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 776/1557] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.674891 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.676427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5f4930de-1695-499b-af2e-1771d31472c6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.678269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5f4930de-1695-499b-af2e-1771d31472c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.684622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef640c5e-adf6-4dfb-88c6-3a4df123e1f3 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.686342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 782/1558] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.687680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.687962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.688220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.689620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.690313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.690657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.690847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.691571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.693192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.703607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 777/1559] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:53.704398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.705789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.707081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.714089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b30c2-0caa-4728-8a63-09e8395c9cce admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.715133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 783/1560] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.715852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.722202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518fa88-892d-4a27-a357-725257e2b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.722858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518fa88-892d-4a27-a357-725257e2b76c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.723161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518fa88-892d-4a27-a357-725257e2b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.723430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518fa88-892d-4a27-a357-725257e2b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.724182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518fa88-892d-4a27-a357-725257e2b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.725305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c0e3d-c32a-4892-84e6-05ce0845f9a6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.726330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518fa88-892d-4a27-a357-725257e2b76c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.729910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.730683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.730971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.731247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.731975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:53.732278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.733887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58563-46f2-4a7c-b628-da540de4c265 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.736838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 778/1561] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:53.737559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dfe7b-99f9-45b6-8970-bba18ddea620 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.737845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dfe7b-99f9-45b6-8970-bba18ddea620 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.738119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dfe7b-99f9-45b6-8970-bba18ddea620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.746725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 784/1562] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:53.747982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc0ad-8364-4f32-8040-b6c19ccbaede None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.748272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc0ad-8364-4f32-8040-b6c19ccbaede None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.748545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc0ad-8364-4f32-8040-b6c19ccbaede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.756036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-564dfe7b-99f9-45b6-8970-bba18ddea620 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.757238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-564dfe7b-99f9-45b6-8970-bba18ddea620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.765116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 779/1563] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.766318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5a1fc0ad-8364-4f32-8040-b6c19ccbaede None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.766454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.766655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.766930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.767489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5a1fc0ad-8364-4f32-8040-b6c19ccbaede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.776173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 785/1564] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.777402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d228275-9168-4a98-8e34-c95e4964b707 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.777684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d228275-9168-4a98-8e34-c95e4964b707 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.777957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d228275-9168-4a98-8e34-c95e4964b707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.784796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.785971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.794537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 780/1565] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.795298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.799135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5d228275-9168-4a98-8e34-c95e4964b707 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.800310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5d228275-9168-4a98-8e34-c95e4964b707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.804767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e8e09-ae6c-42c3-b4e5-7c28624c7fc5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.808770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 786/1566] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.810077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.810396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.810672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.814412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.815445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.815929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.816200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.817398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.819114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.828186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.829252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 781/1567] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:53.829393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.830113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.839111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 787/1568] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.840086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.841517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2676-8586-487f-bc06-931603000ec0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.847294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bddef-5dcc-4de5-9883-897596a5476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.847925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bddef-5dcc-4de5-9883-897596a5476e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.848200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bddef-5dcc-4de5-9883-897596a5476e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.848469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bddef-5dcc-4de5-9883-897596a5476e admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.849190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bddef-5dcc-4de5-9883-897596a5476e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.850343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e8e67-0612-41f5-95e8-8ae02ec519e3 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.851420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bddef-5dcc-4de5-9883-897596a5476e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.854894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.855524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.855802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.856075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.856771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.858716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.861096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 782/1569] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:53.862409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.862701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.862973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.880260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:53.881466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:53.884890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 788/1570] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:53.885841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.889326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 783/1571] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:53.890161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.899886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787f479-f7aa-4dda-bf95-e4d2dbe7a4cf None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.945350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d5c4a-784d-4c3d-9114-6816d525b351 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.949892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.950576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.950854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.951124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.951856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:53.951970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.952155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.952555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.952832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.953105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.953765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.953875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:53.954109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.955705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.966954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 789/1572] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:53.967784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.971447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 784/1573] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:53.972814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:53.977878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65e51f-ca6e-4200-b916-8792fd94fb06 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.982942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.983591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.984001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.984279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.985006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:53.985306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:53.986933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:53.988383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75f2b-6d48-4619-bd70-d9176c04a2ef admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:53.992976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:53.993842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:53.994124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:53.994430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] PATH_INFO: `/v3/projects/9fda976fb52842e28027e89e4d6752fe/users/a1431bb04bd14db986edcf8931bc2210/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:53.998368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 790/1574] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:53.999636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.008398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a0b4e-697c-4a11-9b4d-ce9d1becb165 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.010973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fda976fb52842e28027e89e4d6752fe, user_id=a1431bb04bd14db986edcf8931bc2210, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.013086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.013632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.013740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.014000 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.014344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.015071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:54.015402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.016970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.028049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 785/1575] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:53 2021] PUT /identity/v3/projects/9fda976fb52842e28027e89e4d6752fe/users/a1431bb04bd14db986edcf8931bc2210/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:54.028779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.030907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 791/1576] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:54.038578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.042305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dd97-c93d-4c4c-ae4c-b6f0760607ed admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.095871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a768a-3f1d-4684-af0e-bdd00a4d6841 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.096491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.096491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.097012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.097012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.097710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.100295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.102010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.103007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.103292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.103594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] PATH_INFO: `/v3/projects/f0aee9b9928841cfb7feb62018fc0629/users/9417502138f842d7aab2759e0963cab3/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.117652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0aee9b9928841cfb7feb62018fc0629, user_id=9417502138f842d7aab2759e0963cab3, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.119323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 792/1577] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.119964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.120551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.129809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f19118-d6b1-4cd0-a153-f4cb9767ee12 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.134133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 786/1578] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:54 2021] PUT /identity/v3/projects/f0aee9b9928841cfb7feb62018fc0629/users/9417502138f842d7aab2759e0963cab3/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:54.134773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.187164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.187819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.188103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.188380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.189160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:54.189447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.191067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.192734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7efef-1d24-4550-85c2-6f0cda421ef6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.197900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.198643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.198922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.199198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.199902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.201786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.203034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 793/1579] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:54.207784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.215926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfb611-105f-44a8-b72a-202c2a0a8d39 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.220465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e215a-110a-4be2-9e96-b5b3e55cb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.221127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e215a-110a-4be2-9e96-b5b3e55cb3ca admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.221434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e215a-110a-4be2-9e96-b5b3e55cb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.221748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e215a-110a-4be2-9e96-b5b3e55cb3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.222759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e215a-110a-4be2-9e96-b5b3e55cb3ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.226053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e215a-110a-4be2-9e96-b5b3e55cb3ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.233107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 787/1580] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.235227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.253147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 794/1581] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.254524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.254806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.255081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.271347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:54.272541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:54.296858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c395a-467b-463f-bbf0-b2d3f442b7dd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.327956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 795/1582] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:54.328572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.337309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fad13-3f8b-446b-9d5b-94ca491c5878 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.341981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.342645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.342923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.343193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.344136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.346074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.350435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a0809-fd8b-424a-b7a3-113b59370d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.351089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a0809-fd8b-424a-b7a3-113b59370d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.351366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a0809-fd8b-424a-b7a3-113b59370d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.351637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a0809-fd8b-424a-b7a3-113b59370d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.352338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a0809-fd8b-424a-b7a3-113b59370d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.354265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a0809-fd8b-424a-b7a3-113b59370d20 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.372510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 796/1583] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.373398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.379363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 788/1584] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.380771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.381076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.381342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.399409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:54.400603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:54.432772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e49cfe-77a6-4452-b445-241698198e0e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.456453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 789/1585] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:54.459902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.466287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25bd04-66de-451b-997a-4d86a174f297 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.470783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.471424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.471701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.471969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.472679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.475198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.487056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.487713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.487988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.488254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.489037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.491314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.499936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 790/1586] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.500728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.501504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 797/1587] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.502321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.512123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1b6c8-3e19-44b4-93fb-5e5687588672 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.563956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510fe32-741e-43f7-9d85-fa438c88f206 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.566092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.566814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.567089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.567356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.568071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.568524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.569173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.569449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.569733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.570115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.570442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.572316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.590695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 798/1588] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.591322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.599868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 791/1589] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.599868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.607318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a294d-b2d6-409d-9f33-2b7e4ea4388e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.611831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.612463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.612747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.613022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.613713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.616120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.636477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 792/1590] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.637274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.645417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702789-61f3-45b4-a4a7-05b36a7a6ee0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.646436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b511eb5-c626-4b7b-b970-117b980998d0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.649277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.649911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.650230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.650506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.651163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.651792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.652077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.652351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.653042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.654968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.659709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.661137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.671582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 799/1591] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:54.672374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.675826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 793/1592] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.680102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.681072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd8c0-9c82-40f7-9533-6e8314651d54 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.684668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.685307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.685586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.685861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.689993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b86f50-c1a5-4efe-bb61-8b79d2793802 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.696790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.697002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.697605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.697852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.698298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.698676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.699071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.701344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.709551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 800/1593] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:54.710570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.721029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf360f-8bba-48eb-a9a7-b0e464b60b6e service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.729160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.729825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.730103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.730403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.731373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.732150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 794/1594] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:54 2021] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:54.733293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.733406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.743248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd30460-acd6-4fd1-80ab-cbe86543a1d4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.744723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 801/1595] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.745891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.752256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.753345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.753345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.753683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.754506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.756192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.756716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b671ce5-bcc3-4f31-9582-0c4c23d5f43b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.761887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.762616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.762893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.763320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.763904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.765494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.772150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 795/1596] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.772150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.783102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293995d-59f8-4aaa-906b-a1616301b6b1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.784284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 802/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.785011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.788760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.789421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.789692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.789962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.790908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.793412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.795410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6a0df-1f48-45dc-99aa-6dc87c48b1b9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.800515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.801175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.801459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.801730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.802503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.806633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.807844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 796/1598] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.808755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.821252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24db681-2268-40d3-b370-134e559f7ecd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.824102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 803/1599] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.825144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.829649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.830982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.831284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.831533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.833320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.835679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.838027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d24d-816f-4627-bae9-a6cb7b116769 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.843368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.844376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.844726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.845272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] PATH_INFO: `/v3/projects/15a2cfe394c34c5ebf8130a0cf7ceb2f/users/5a4953eabc674d109ca8f01a381f3e0c/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.848796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 797/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.850336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.861601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb99bf-d9b0-4bcf-a97c-b6a3f109fa82 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.867143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.867833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.868302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.868429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.868836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a2cfe394c34c5ebf8130a0cf7ceb2f, user_id=5a4953eabc674d109ca8f01a381f3e0c, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.869097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.871033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.872862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.882483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 798/1601] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.883392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.890128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 804/1602] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:54 2021] PUT /identity/v3/projects/15a2cfe394c34c5ebf8130a0cf7ceb2f/users/5a4953eabc674d109ca8f01a381f3e0c/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:54.895380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.907649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9e771-7b69-424a-ad3e-c7e6cc363292 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.968554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e21b4-466a-4d2f-9639-08ab28caa381 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:54.969885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.970604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.970859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.971188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.971920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.973520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.974951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:54.975982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:54.976627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:54.977347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:54.978998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:54.982200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:54.987562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 799/1603] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.987562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:54.998668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 805/1604] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:54.999835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.008338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150ce3b-6605-4e0e-8b98-792005096825 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.014317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f7a88-d1da-406e-914d-08f0fa52137c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.014537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.015306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.016093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.016093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.017013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.019002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.023268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d4ee1-a672-4bd3-a10a-e6f51198a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.024248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4ee1-a672-4bd3-a10a-e6f51198a66b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.025402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4ee1-a672-4bd3-a10a-e6f51198a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.025749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4ee1-a672-4bd3-a10a-e6f51198a66b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.026548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d4ee1-a672-4bd3-a10a-e6f51198a66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.028341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d4ee1-a672-4bd3-a10a-e6f51198a66b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.034443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 800/1605] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:55.035331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.044148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 806/1606] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:55.045717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6caed-0d9a-499a-9310-0c001790fa91 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.048671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.049015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.049437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.051105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.051994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.052267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.053261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] PATH_INFO: `/v3/projects/9d0255d615a14a41af48a7a999a42469/users/ff7f1cc9a2214907871542822081375f/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.069517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0255d615a14a41af48a7a999a42469, user_id=ff7f1cc9a2214907871542822081375f, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.072351 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.082265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] MFA Rules not processed for user `5a4953eabc674d109ca8f01a381f3e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.084505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.087518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 801/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:55 2021] PUT /identity/v3/projects/9d0255d615a14a41af48a7a999a42469/users/ff7f1cc9a2214907871542822081375f/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:55.088547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.160046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 807/1608] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.161017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.169322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dae1c-384b-417b-8d3f-7968ed8dfaee admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.173064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a4a6-e701-4b55-95c2-0d4bd248db51 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.175834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.177442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.178432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.178546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.178726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] PATH_INFO: `/v3/projects/3ed2d4c5a9874ace89374c1696479681/users/a062bf61e1144311a7824d1c43f9ef3b/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.179509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.179793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.180145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] PATH_INFO: `/v3/projects/593ba127331047e78564382ed40c9a6c/users/63f71308767b4b21bd8f2ad7f68999c9/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.198623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] RBAC: Authorizing `identity:create_grant(project_id=593ba127331047e78564382ed40c9a6c, user_id=63f71308767b4b21bd8f2ad7f68999c9, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.201132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed2d4c5a9874ace89374c1696479681, user_id=a062bf61e1144311a7824d1c43f9ef3b, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.201941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.204723 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.227145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 802/1609] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:55 2021] PUT /identity/v3/projects/3ed2d4c5a9874ace89374c1696479681/users/a062bf61e1144311a7824d1c43f9ef3b/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:55.228576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.241445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 808/1610] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:55 2021] PUT /identity/v3/projects/593ba127331047e78564382ed40c9a6c/users/63f71308767b4b21bd8f2ad7f68999c9/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:55.242412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.345466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8ea3-f78d-4b45-b82e-8bc0f2be908d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.352095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2dd9a-94cd-4dad-ba77-86a78ea5744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.353538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2dd9a-94cd-4dad-ba77-86a78ea5744d admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.353884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2dd9a-94cd-4dad-ba77-86a78ea5744d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.354252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2dd9a-94cd-4dad-ba77-86a78ea5744d admin admin] PATH_INFO: `/v3/projects/b73c4bba33654f50a7e208a2e010dd21/users/9e8267cd9abe4c6ea0a1272829849eef/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.372282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d256-47e1-4590-ba7c-9ebb709f27b0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.375074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2dd9a-94cd-4dad-ba77-86a78ea5744d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73c4bba33654f50a7e208a2e010dd21, user_id=9e8267cd9abe4c6ea0a1272829849eef, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.378242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2dd9a-94cd-4dad-ba77-86a78ea5744d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.378712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.379620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.379899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.380171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] PATH_INFO: `/v3/projects/04e0b910ad794c7db450e6bb1c96cd01/users/1b47404ef24941829d657acb729f93da/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.403862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e0b910ad794c7db450e6bb1c96cd01, user_id=1b47404ef24941829d657acb729f93da, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.406033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 809/1611] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:55 2021] PUT /identity/v3/projects/b73c4bba33654f50a7e208a2e010dd21/users/9e8267cd9abe4c6ea0a1272829849eef/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:55.407590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb835-3edf-480d-9eb6-622686e2633b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.407984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb835-3edf-480d-9eb6-622686e2633b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.410014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb835-3edf-480d-9eb6-622686e2633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.419612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.445947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-adbdb835-3edf-480d-9eb6-622686e2633b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.447483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-adbdb835-3edf-480d-9eb6-622686e2633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.450168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 803/1612] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:55 2021] PUT /identity/v3/projects/04e0b910ad794c7db450e6bb1c96cd01/users/1b47404ef24941829d657acb729f93da/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:55.451905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.545880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b027996-3b1b-44c7-9ad0-95fa9f08a4a6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.549092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 810/1613] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.550864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530aa1-1743-42a0-b7cf-e5583065dde0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.551371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530aa1-1743-42a0-b7cf-e5583065dde0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.551656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530aa1-1743-42a0-b7cf-e5583065dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.558835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb25af-48e3-4398-a89e-80d765109e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.559749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb25af-48e3-4398-a89e-80d765109e56 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.559876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb25af-48e3-4398-a89e-80d765109e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.561695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb25af-48e3-4398-a89e-80d765109e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.562468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb25af-48e3-4398-a89e-80d765109e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.564462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb25af-48e3-4398-a89e-80d765109e56 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.595036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-01530aa1-1743-42a0-b7cf-e5583065dde0 None None] MFA Rules not processed for user `a062bf61e1144311a7824d1c43f9ef3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.595947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-01530aa1-1743-42a0-b7cf-e5583065dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.600851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 804/1614] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:55.601090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9b87-58a8-456d-b21d-c0c2f44b6b5a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.601394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9b87-58a8-456d-b21d-c0c2f44b6b5a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.602301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9b87-58a8-456d-b21d-c0c2f44b6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.636077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ba9f9b87-58a8-456d-b21d-c0c2f44b6b5a None None] MFA Rules not processed for user `63f71308767b4b21bd8f2ad7f68999c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.637345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ba9f9b87-58a8-456d-b21d-c0c2f44b6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.679399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 811/1615] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.691829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d935a-971a-494f-8abc-d72020c5ea8e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.692134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d935a-971a-494f-8abc-d72020c5ea8e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.692592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d935a-971a-494f-8abc-d72020c5ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.732718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-539d935a-971a-494f-8abc-d72020c5ea8e None None] MFA Rules not processed for user `9e8267cd9abe4c6ea0a1272829849eef`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.736484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 805/1616] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.736633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-539d935a-971a-494f-8abc-d72020c5ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.736754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.736754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.736754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.756341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.757637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.827101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 812/1617] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.828463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa181-18c9-4072-ac79-8ea0445d85bd None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.828823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa181-18c9-4072-ac79-8ea0445d85bd None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.829176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa181-18c9-4072-ac79-8ea0445d85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.842462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 806/1618] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.843569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.845168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.880199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ccdfa181-18c9-4072-ac79-8ea0445d85bd None None] MFA Rules not processed for user `9417502138f842d7aab2759e0963cab3`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:55.881880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ccdfa181-18c9-4072-ac79-8ea0445d85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:55.916038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e48d9-cf31-40b6-81d1-7c28b0b8e406 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.919808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.920516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.920966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.921246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.932603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.935081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.947262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 807/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:55.948326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.960728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 813/1620] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:55.961853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c795f82-dd51-43fe-a27b-1f87cb0c3295 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:55.962762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfb80e-5fcb-4f36-8af7-4c2c5a719319 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.963146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfb80e-5fcb-4f36-8af7-4c2c5a719319 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.963495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfb80e-5fcb-4f36-8af7-4c2c5a719319 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.967994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:55.968661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:55.968943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:55.969216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:55.970019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:55.972070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:55.974523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 814/1621] 10.222.0.57 () {54 vars in 961 bytes} [Wed Dec 15 13:03:55 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:03:55.977947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfb80e-5fcb-4f36-8af7-4c2c5a719319 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.995822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 808/1622] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:55.996504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:55.998971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfb80e-5fcb-4f36-8af7-4c2c5a719319 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.004861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.007153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.007798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.008011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb263-2198-4156-97e6-c3ada89b84fa admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.008611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.009868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.012562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.012940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef53c88-fd37-4668-836b-84e4d4ba897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.013950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53c88-fd37-4668-836b-84e4d4ba897c admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.014072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53c88-fd37-4668-836b-84e4d4ba897c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.014328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef53c88-fd37-4668-836b-84e4d4ba897c admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.015037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef53c88-fd37-4668-836b-84e4d4ba897c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.017328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef53c88-fd37-4668-836b-84e4d4ba897c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.051237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 815/1623] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:56.051677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 809/1624] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:55 2021] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:56.053382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.053593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a3a2-7f54-44d2-99e1-e9a4d75c12d6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.053885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a3a2-7f54-44d2-99e1-e9a4d75c12d6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.054174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a3a2-7f54-44d2-99e1-e9a4d75c12d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.073066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-44e3a3a2-7f54-44d2-99e1-e9a4d75c12d6 None None] MFA Rules not processed for user `9417502138f842d7aab2759e0963cab3`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:56.074389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-44e3a3a2-7f54-44d2-99e1-e9a4d75c12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:56.122126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd750d-0f22-476b-a9b4-564beb1e948b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.147888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 810/1625] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:56.147888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.147888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.147888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.170883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:56.172179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:56.205004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.205662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.206278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.206603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.277332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 811/1626] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Dec 15 13:03:56 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:56.278790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.286465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.288677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.292584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783d6a-a1ec-40c4-8cf7-057dee164ab6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.300339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.301821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.301940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 816/1627] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:56.302095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.302948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.303775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.306638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.313652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.322890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 812/1628] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:56.323811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.336444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5b041-b806-41aa-b006-6a3503a108c6 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.339899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fc829-957b-4d05-a39f-5b1f72cd7bfb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.347021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92937d-9dd1-42d6-aca0-dd7c027e8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.347757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92937d-9dd1-42d6-aca0-dd7c027e8b87 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.348088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92937d-9dd1-42d6-aca0-dd7c027e8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.348371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92937d-9dd1-42d6-aca0-dd7c027e8b87 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.349350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92937d-9dd1-42d6-aca0-dd7c027e8b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.351821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92937d-9dd1-42d6-aca0-dd7c027e8b87 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.362114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.362997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.363282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.363555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.364299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.367127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.388102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 813/1629] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:56 2021] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:56.398508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefd8c-263b-471e-b783-c5266138413e None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.398686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 817/1630] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:03:56 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:56.398813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefd8c-263b-471e-b783-c5266138413e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.398813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeefd8c-263b-471e-b783-c5266138413e None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.398987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.399476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 814/1631] 10.222.0.57 () {54 vars in 961 bytes} [Wed Dec 15 13:03:56 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:03:56.405360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeefd8c-263b-471e-b783-c5266138413e None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.422341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d06e2-56d3-49a2-905d-78f6b5cf5d6d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.439667 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.440242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeefd8c-263b-471e-b783-c5266138413e None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.440410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.440716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.440998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.451878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.452788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.453070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.454069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] PATH_INFO: `/v3/projects/6cbf89d2f37b4887a4cea2b93b4ec111/users/52e187e3b2f54eae9f4252198a0f39ca/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.492541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbf89d2f37b4887a4cea2b93b4ec111, user_id=52e187e3b2f54eae9f4252198a0f39ca, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.498107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.525515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 815/1632] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:56 2021] PUT /identity/v3/projects/6cbf89d2f37b4887a4cea2b93b4ec111/users/52e187e3b2f54eae9f4252198a0f39ca/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:56.525515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.548036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.550513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.562127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 818/1633] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:56.563182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.578804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43485d-27b4-4981-baf4-125ef4bf0c0d service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.652125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846a0d2-9d00-43f5-a680-ccbb3cd9dc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.653288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846a0d2-9d00-43f5-a680-ccbb3cd9dc0c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.653572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846a0d2-9d00-43f5-a680-ccbb3cd9dc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.653901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846a0d2-9d00-43f5-a680-ccbb3cd9dc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.654858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846a0d2-9d00-43f5-a680-ccbb3cd9dc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.657456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846a0d2-9d00-43f5-a680-ccbb3cd9dc0c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.671924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 819/1634] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:56.671924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.671924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.671924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.696656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:56.697891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:56.731817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07db6a5-76df-4871-874f-68a6c856de48 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.746785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.747532 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.747823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.748102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.749146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.752235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.780789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 816/1635] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:56.781471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.815134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7aa11-6150-4366-bcd5-ca738ef317e9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.820427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.821107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.821523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.821859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.822652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.825402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.838509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 820/1636] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Dec 15 13:03:56 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:56.839488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.840084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 817/1637] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:56.841055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.851227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdf517-a882-4ba4-b9d4-61f79b7aa801 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.863103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.864412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.864932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.865650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] PATH_INFO: `/v3/projects/57a036522d38489b8de665d91dc382ff/users/bc07ae59fc2346f0b1a5089485b86239/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.870769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96021b5e-556b-44bb-afda-af08745f31d0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:56.877623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:56.878561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:56.878846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:56.879125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] PATH_INFO: `/v3/projects/5a475a4d480a41129487d29b563c0a1f/users/4c698fd6fc1344b7a6e40709a6d0b491/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:56.890359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a036522d38489b8de665d91dc382ff, user_id=bc07ae59fc2346f0b1a5089485b86239, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.893193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.906301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a475a4d480a41129487d29b563c0a1f, user_id=4c698fd6fc1344b7a6e40709a6d0b491, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:56.909196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:56.914698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 821/1638] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:56 2021] PUT /identity/v3/projects/57a036522d38489b8de665d91dc382ff/users/bc07ae59fc2346f0b1a5089485b86239/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:56.916026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:56.936266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 818/1639] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:56 2021] PUT /identity/v3/projects/5a475a4d480a41129487d29b563c0a1f/users/4c698fd6fc1344b7a6e40709a6d0b491/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:56.936266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:57.059457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db883c6-7ba1-488c-9a93-07d4932148cf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.078389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43017c-a5cc-4f46-8798-bbe4c06c0948 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.105226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.106326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.106612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.107010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] PATH_INFO: `/v3/projects/6cbf89d2f37b4887a4cea2b93b4ec111/users/52e187e3b2f54eae9f4252198a0f39ca/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.111854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbf89d2f37b4887a4cea2b93b4ec111, user_id=52e187e3b2f54eae9f4252198a0f39ca, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:57.114866 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:57.155313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 819/1640] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:56 2021] PUT /identity/v3/projects/6cbf89d2f37b4887a4cea2b93b4ec111/users/52e187e3b2f54eae9f4252198a0f39ca/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:57.155313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:57.158946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.247324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.247324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.247324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.278052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:57.280634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:57.296755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 822/1641] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:56 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:57.304885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:57.317656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695dc75-8de1-4a1e-a65d-f7e1b5086fa8 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.323782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9916109-5b9c-40ca-a5bf-4baad1a804a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.324470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9916109-5b9c-40ca-a5bf-4baad1a804a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.324878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9916109-5b9c-40ca-a5bf-4baad1a804a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.325167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9916109-5b9c-40ca-a5bf-4baad1a804a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.326576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9916109-5b9c-40ca-a5bf-4baad1a804a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:57.329019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db6d8-2ee7-4be2-88da-0f0e50dcf2ab admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.329483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9916109-5b9c-40ca-a5bf-4baad1a804a6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:57.343241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318e2c-b695-42d8-87d3-d0dcbfb20e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.343929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318e2c-b695-42d8-87d3-d0dcbfb20e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.344214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318e2c-b695-42d8-87d3-d0dcbfb20e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.344491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318e2c-b695-42d8-87d3-d0dcbfb20e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.346276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 823/1642] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:57 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:57.348152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f103-eb93-494d-a02e-ed1cf30ef64c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.348355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c318e2c-b695-42d8-87d3-d0dcbfb20e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:57.348879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f103-eb93-494d-a02e-ed1cf30ef64c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.349716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2f103-eb93-494d-a02e-ed1cf30ef64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.350622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c318e2c-b695-42d8-87d3-d0dcbfb20e47 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:57.381220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 820/1643] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:03:57 2021] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:03:57.385244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8965-4656-485c-962f-f98133e88606 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.385548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8965-4656-485c-962f-f98133e88606 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.386738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8965-4656-485c-962f-f98133e88606 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.399228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 821/1644] 10.222.0.57 () {54 vars in 912 bytes} [Wed Dec 15 13:03:57 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:03:57.400390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8965-4656-485c-962f-f98133e88606 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:57.403884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-dcd2f103-eb93-494d-a02e-ed1cf30ef64c None None] MFA Rules not processed for user `52e187e3b2f54eae9f4252198a0f39ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:57.409721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-dcd2f103-eb93-494d-a02e-ed1cf30ef64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:57.418802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8965-4656-485c-962f-f98133e88606 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.425499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.426640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.427079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.427655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] PATH_INFO: `/v3/projects/5a475a4d480a41129487d29b563c0a1f/users/4c698fd6fc1344b7a6e40709a6d0b491/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.429907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a475a4d480a41129487d29b563c0a1f, user_id=4c698fd6fc1344b7a6e40709a6d0b491, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:57.433445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:57.454558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 822/1645] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:57 2021] PUT /identity/v3/projects/5a475a4d480a41129487d29b563c0a1f/users/4c698fd6fc1344b7a6e40709a6d0b491/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:57.454558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:57.579669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 824/1646] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:57 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:57.580195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.580427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.580704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.585674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974de8-ede0-4c2a-ac1a-9acb2d59664c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.600512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb175c-b823-49bf-98f7-45fe069e4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.602263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb175c-b823-49bf-98f7-45fe069e4085 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.603849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb175c-b823-49bf-98f7-45fe069e4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.604209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb175c-b823-49bf-98f7-45fe069e4085 admin admin] PATH_INFO: `/v3/projects/57a036522d38489b8de665d91dc382ff/users/bc07ae59fc2346f0b1a5089485b86239/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.610796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb175c-b823-49bf-98f7-45fe069e4085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a036522d38489b8de665d91dc382ff, user_id=bc07ae59fc2346f0b1a5089485b86239, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:57.613510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb175c-b823-49bf-98f7-45fe069e4085 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:57.638257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:57.650760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 823/1647] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:03:57 2021] PUT /identity/v3/projects/57a036522d38489b8de665d91dc382ff/users/bc07ae59fc2346f0b1a5089485b86239/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:57.650967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:57.651175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f47df6-8b8f-410e-9ba3-ea20964e403b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.651175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f47df6-8b8f-410e-9ba3-ea20964e403b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.651175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f47df6-8b8f-410e-9ba3-ea20964e403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.706018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-22f47df6-8b8f-410e-9ba3-ea20964e403b None None] MFA Rules not processed for user `4c698fd6fc1344b7a6e40709a6d0b491`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:57.709216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-22f47df6-8b8f-410e-9ba3-ea20964e403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:57.769918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 825/1648] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:03:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:57.772056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:57.894625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 824/1649] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:57 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:57.897138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a8cf-e64a-42ea-b6d5-59c495008dfa None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.897423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a8cf-e64a-42ea-b6d5-59c495008dfa None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.897953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a8cf-e64a-42ea-b6d5-59c495008dfa None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.899795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 825/1650] 10.222.0.57 () {54 vars in 912 bytes} [Wed Dec 15 13:03:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:03:57.903822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.904107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.904753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.919502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19155d-2e39-45e1-a469-793179516bcf None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:57.936594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a0043-9e85-40eb-bf43-da6da9fcd23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:57.937255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a0043-9e85-40eb-bf43-da6da9fcd23a service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:57.937669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a0043-9e85-40eb-bf43-da6da9fcd23a service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:57.937945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a0043-9e85-40eb-bf43-da6da9fcd23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:57.963874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] MFA Rules not processed for user `bc07ae59fc2346f0b1a5089485b86239`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:57.965711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:58.072732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a0043-9e85-40eb-bf43-da6da9fcd23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.074221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a0043-9e85-40eb-bf43-da6da9fcd23a service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.104561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 826/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:57 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:58.106178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.106607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.106982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.109246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 826/1652] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:57 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:58.110439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:58.121422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fe965-d859-498d-a1bc-1a780adf9249 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:58.126242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e4c2-61ae-4a9d-88dd-8d89c6bdc613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:58.126499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e4c2-61ae-4a9d-88dd-8d89c6bdc613 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.126710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e4c2-61ae-4a9d-88dd-8d89c6bdc613 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.126980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e4c2-61ae-4a9d-88dd-8d89c6bdc613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.141294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e4c2-61ae-4a9d-88dd-8d89c6bdc613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.143196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e4c2-61ae-4a9d-88dd-8d89c6bdc613 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.158540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 827/1653] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:58.160004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.160293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.160721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.178171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] MFA Rules not processed for user `1b47404ef24941829d657acb729f93da`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:58.187194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:58.202730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:58.203969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:58.230197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 828/1654] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:03:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:58.243942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:58.245600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:58.330776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354513-cc6a-478f-a57f-fde7e7190b15 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:58.341374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:58.342045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.342346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.342618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.365279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 827/1655] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:58.366408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:58.376897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.379090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.389293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba06c14-c36e-42a8-b0c1-e0377d0cc36c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:58.391746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 829/1656] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:58.392608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:58.397144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:58.398195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.400318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.400871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.403689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c4aa-ad09-40c2-ac74-42094adf780b service glance] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:58.408652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654332d-60ce-49a4-baa9-6ca24afda76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:58.409507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654332d-60ce-49a4-baa9-6ca24afda76d service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.409966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654332d-60ce-49a4-baa9-6ca24afda76d service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.410453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654332d-60ce-49a4-baa9-6ca24afda76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.423173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.423866 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654332d-60ce-49a4-baa9-6ca24afda76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.425295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.425690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654332d-60ce-49a4-baa9-6ca24afda76d service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.439561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 830/1657] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:58 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:58.441401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.441895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.442381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.469621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 828/1658] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:58 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:58.502641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] MFA Rules not processed for user `1b47404ef24941829d657acb729f93da`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:58.506446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:58.533095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 831/1659] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:58.599382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:58.620394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244357a-d01c-4208-b924-fd214e5f0323 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:58.633046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:58.634267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.634552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.634826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.645647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.648181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.662541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:58.673652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5083c47-9571-43d6-8cae-468aeeaf7fa7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:58.681873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 829/1660] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:58.685472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:58.685472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:58.685472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:58.685472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:58.823756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:58.825960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:58.848246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 832/1661] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:58 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:03:59.252019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:59.300766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:59.330486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29cc9d-ad0a-46db-9416-cc09079bbd53 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:59.352645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c698fd6fc1344b7a6e40709a6d0b491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a475a4d480a41129487d29b563c0a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:59.353536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.353707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.358823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.359662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:59.368760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:59.371161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ead67a-bdd1-4d6e-8fd3-f468e2d5f9c6 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:59.401841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 833/1662] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:59.403793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcfb85-2159-432d-b601-82d3d486e217 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.406515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcfb85-2159-432d-b601-82d3d486e217 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.406985 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcfb85-2159-432d-b601-82d3d486e217 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.409726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 834/1663] 10.222.0.57 () {54 vars in 912 bytes} [Wed Dec 15 13:03:59 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:03:59.410764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcfb85-2159-432d-b601-82d3d486e217 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:59.435640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcfb85-2159-432d-b601-82d3d486e217 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:59.437730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579ebe-8810-44fd-8414-610d7152a7b7 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:59.446673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:59.448200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.448694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.449466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] PATH_INFO: `/v3/users/5a4953eabc674d109ca8f01a381f3e0c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.450329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214273a1-8d0d-4246-9b11-73302cbeef60 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c698fd6fc1344b7a6e40709a6d0b491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a475a4d480a41129487d29b563c0a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:59.452065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214273a1-8d0d-4246-9b11-73302cbeef60 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.453288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214273a1-8d0d-4246-9b11-73302cbeef60 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.453415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4953eabc674d109ca8f01a381f3e0c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:59.454065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214273a1-8d0d-4246-9b11-73302cbeef60 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.455838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:59.458530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214273a1-8d0d-4246-9b11-73302cbeef60 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:59.461159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214273a1-8d0d-4246-9b11-73302cbeef60 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:59.508986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 835/1664] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:03:59 2021] POST /identity/v3/projects => generated 354 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:03:59.513669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c403-1d69-4f52-b713-104a0837f2b7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.513956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c403-1d69-4f52-b713-104a0837f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.514473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c403-1d69-4f52-b713-104a0837f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.523044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4953eabc674d109ca8f01a381f3e0c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:03:59.535038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4953eabc674d109ca8f01a381f3e0c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:03:59.547854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4953eabc674d109ca8f01a381f3e0c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:03:59.564958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4953eabc674d109ca8f01a381f3e0c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:03:59.565792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4953eabc674d109ca8f01a381f3e0c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:03:59.574301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 830/1665] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:03:59 2021] DELETE /identity/v3/users/5a4953eabc674d109ca8f01a381f3e0c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:03:59.575224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:59.576757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:59.603538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-35c8c403-1d69-4f52-b713-104a0837f2b7 None None] MFA Rules not processed for user `6300d566628547b48cbe60769799c1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:59.606604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-35c8c403-1d69-4f52-b713-104a0837f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:59.672177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473904a3-fbad-4fb5-bb67-9285835d2034 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:59.678024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c698fd6fc1344b7a6e40709a6d0b491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a475a4d480a41129487d29b563c0a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:59.678735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.679022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.680028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.681843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:03:59.682171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:59.684006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73479b6b-9b74-4a41-ba0c-34864588377f tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:59.700996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 831/1666] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:03:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:03:59.702548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.702881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.703159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.718607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 836/1667] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:03:59 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:59.739608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:59.740893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:59.746567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9766d0-3290-481a-90c4-2400af4630f3 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.746877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9766d0-3290-481a-90c4-2400af4630f3 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.747202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9766d0-3290-481a-90c4-2400af4630f3 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.749794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 837/1668] 10.222.0.57 () {54 vars in 912 bytes} [Wed Dec 15 13:03:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:03:59.757042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.757337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.757595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.787900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] MFA Rules not processed for user `6300d566628547b48cbe60769799c1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:03:59.789853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:59.803511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 838/1669] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:03:59 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:03:59.804406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:59.827686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b5651-4ebe-41df-bb95-dcb51909a8ff None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:59.846232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c698fd6fc1344b7a6e40709a6d0b491', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a475a4d480a41129487d29b563c0a1f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:59.850258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.852574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.852869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] PATH_INFO: `/v3/projects/bd7b713c791b4d72922ff6c96df0eed7` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.856853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd7b713c791b4d72922ff6c96df0eed7)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:59.858846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:59.894248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 832/1670] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:03:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:03:59.895090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:03:59.899164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:03:59.935770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaafe75-8e57-434b-9e87-a38034ab0796 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:03:59.948999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:03:59.949838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:03:59.950977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:03:59.951257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:03:59.983119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:03:59.986504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:03:59.992623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7b713c791b4d72922ff6c96df0eed7', 'request_id': 'req-65821165-f5b3-41e5-9bb8-a7728156f5b7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.009051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7b713c791b4d72922ff6c96df0eed7', 'request_id': 'req-65821165-f5b3-41e5-9bb8-a7728156f5b7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.012323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 833/1671] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:03:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:00.013361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:00.017100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.031937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7b713c791b4d72922ff6c96df0eed7', 'request_id': 'req-65821165-f5b3-41e5-9bb8-a7728156f5b7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.046423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8d4b3-dbe7-4712-b575-a84cb39c00cc service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:00.058189 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] The token cache is being invalidate because project bd7b713c791b4d72922ff6c96df0eed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:00.059557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.061556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.067905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 839/1672] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:03:59 2021] DELETE /identity/v3/projects/bd7b713c791b4d72922ff6c96df0eed7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:00.068906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:00.072653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.156426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:00.157131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:00.157469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:00.157745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:00.160286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.203560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:00.217189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:00.232325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 834/1673] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:00 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:00.242302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821165-f5b3-41e5-9bb8-a7728156f5b7 tempest-VolumeQuotaClassesTest-1784215349 tempest-VolumeQuotaClassesTest-1784215349-project-admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:00.247945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:00.249300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:00.249554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:00.249832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:00.252430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.362188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:00.363950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd31ba-f11a-4e24-b35d-dea1052e0957 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:00.376857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 840/1674] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:00.485398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:00.488440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.507162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4291-ca45-44e5-b9e1-03c82c5035be service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:00.513305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:00.514217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:00.514502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:00.514776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] PATH_INFO: `/v3/users/9e8267cd9abe4c6ea0a1272829849eef` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:00.516960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8267cd9abe4c6ea0a1272829849eef)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:00.519710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:00.587137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8267cd9abe4c6ea0a1272829849eef'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.596598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8267cd9abe4c6ea0a1272829849eef'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.607006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8267cd9abe4c6ea0a1272829849eef'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.630090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8267cd9abe4c6ea0a1272829849eef'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.631761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8267cd9abe4c6ea0a1272829849eef'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:00.640163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 835/1675] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:00 2021] DELETE /identity/v3/users/9e8267cd9abe4c6ea0a1272829849eef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:00.644363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:00.644648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:00.644922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:00.684612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:00.685837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.767129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 841/1676] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:00.785587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:00.788546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:00.953328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa143-6a3a-4b8d-868d-2c49532fdf9e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:00.965627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:00.967171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:00.968438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:00.968749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:00.993470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:00.997355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:01.030815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 836/1677] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:01.402260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:01.409536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:01.423298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:01.425205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:01.478256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24c171-44d8-464b-b1e6-14c784924581 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:01.530480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:01.531329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:01.531614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:01.531893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] PATH_INFO: `/v3/users/a062bf61e1144311a7824d1c43f9ef3b` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:01.540270 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a062bf61e1144311a7824d1c43f9ef3b)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:01.555547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:01.733987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a062bf61e1144311a7824d1c43f9ef3b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:01.742338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3ccf-c7cc-4066-985f-fa37aed070e7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:01.758603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a062bf61e1144311a7824d1c43f9ef3b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:01.760654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:01.761352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:01.761643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:01.762068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:01.768896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:01.787203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a062bf61e1144311a7824d1c43f9ef3b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:01.813979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:01.815724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde709d-4ed7-4d48-80f3-b03d953acd1a service placement] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:01.845093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a062bf61e1144311a7824d1c43f9ef3b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:01.849524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 842/1678] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:01 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:01.858595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a062bf61e1144311a7824d1c43f9ef3b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:01.890279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 837/1679] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:01 2021] DELETE /identity/v3/users/a062bf61e1144311a7824d1c43f9ef3b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:01.895143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:01.895522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:01.895725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:01.935270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:01.936526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:02.133453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 843/1680] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:02.324541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:02.326537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:02.498540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f912b80-d037-46cc-9042-ccc063c218ee admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:02.507790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:02.508462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:02.508745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:02.509016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:02.542084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:02.543580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:02.582829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 838/1681] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:03.027848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:03.031290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:03.055069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f34ce-ef7c-4bd8-b66b-ca02e73b4511 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:03.076375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:03.077678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:03.079912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:03.080421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] PATH_INFO: `/v3/projects/15a2cfe394c34c5ebf8130a0cf7ceb2f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:03.083218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a2cfe394c34c5ebf8130a0cf7ceb2f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:03.092839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:03.200492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a2cfe394c34c5ebf8130a0cf7ceb2f', 'request_id': 'req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.211324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a2cfe394c34c5ebf8130a0cf7ceb2f', 'request_id': 'req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.227921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a2cfe394c34c5ebf8130a0cf7ceb2f', 'request_id': 'req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.240376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] The token cache is being invalidate because project 15a2cfe394c34c5ebf8130a0cf7ceb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:03.240896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.253803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.260858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 844/1682] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:03 2021] DELETE /identity/v3/projects/15a2cfe394c34c5ebf8130a0cf7ceb2f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:03.264647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:03.275910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a26492-a656-4b04-b067-a15610190feb service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:03.426878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:03.428276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:03.428788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:03.428788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] PATH_INFO: `/v3/users/52e187e3b2f54eae9f4252198a0f39ca` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:03.430056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e187e3b2f54eae9f4252198a0f39ca)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:03.435024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:03.554889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e187e3b2f54eae9f4252198a0f39ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.584457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e187e3b2f54eae9f4252198a0f39ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.650642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e187e3b2f54eae9f4252198a0f39ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.680852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e187e3b2f54eae9f4252198a0f39ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.685321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e187e3b2f54eae9f4252198a0f39ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:03.694381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 839/1683] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:03 2021] DELETE /identity/v3/users/52e187e3b2f54eae9f4252198a0f39ca => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:03.895734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:03.897848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:03.922346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bf07-bce6-48aa-b551-b5608e0cac1f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:04.125916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:04.133419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:04.133922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:04.134425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] PATH_INFO: `/v3/projects/b73c4bba33654f50a7e208a2e010dd21` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:04.136207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73c4bba33654f50a7e208a2e010dd21)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:04.138345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:04.334344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73c4bba33654f50a7e208a2e010dd21', 'request_id': 'req-353c8e51-edfa-4093-aed6-6fad580d10d8'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.365140 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73c4bba33654f50a7e208a2e010dd21', 'request_id': 'req-353c8e51-edfa-4093-aed6-6fad580d10d8'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.382778 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73c4bba33654f50a7e208a2e010dd21', 'request_id': 'req-353c8e51-edfa-4093-aed6-6fad580d10d8'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.400303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] The token cache is being invalidate because project b73c4bba33654f50a7e208a2e010dd21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:04.400791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.402531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.407508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 845/1684] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:03 2021] DELETE /identity/v3/projects/b73c4bba33654f50a7e208a2e010dd21 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:04.408674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:04.410309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:04.436732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8911-43b0-4102-bfec-ae0e3445cb75 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:04.450456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:04.451769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:04.604960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c8e51-edfa-4093-aed6-6fad580d10d8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:04.622241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53663efa-c943-4452-b081-773080903577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:04.623430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53663efa-c943-4452-b081-773080903577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:04.623870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53663efa-c943-4452-b081-773080903577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:04.624300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53663efa-c943-4452-b081-773080903577 admin admin] PATH_INFO: `/v3/projects/3ed2d4c5a9874ace89374c1696479681` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:04.625679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53663efa-c943-4452-b081-773080903577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed2d4c5a9874ace89374c1696479681)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:04.627830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53663efa-c943-4452-b081-773080903577 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:04.634168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:04.635104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:04.635387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:04.635659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] PATH_INFO: `/v3/users/4c698fd6fc1344b7a6e40709a6d0b491` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:04.637720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c698fd6fc1344b7a6e40709a6d0b491)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:04.660402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:04.736662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53663efa-c943-4452-b081-773080903577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed2d4c5a9874ace89374c1696479681', 'request_id': 'req-53663efa-c943-4452-b081-773080903577'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.753881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53663efa-c943-4452-b081-773080903577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed2d4c5a9874ace89374c1696479681', 'request_id': 'req-53663efa-c943-4452-b081-773080903577'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.774316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53663efa-c943-4452-b081-773080903577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed2d4c5a9874ace89374c1696479681', 'request_id': 'req-53663efa-c943-4452-b081-773080903577'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.790075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c698fd6fc1344b7a6e40709a6d0b491'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.804562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c698fd6fc1344b7a6e40709a6d0b491'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.812993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53663efa-c943-4452-b081-773080903577 admin admin] The token cache is being invalidate because project 3ed2d4c5a9874ace89374c1696479681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:04.813296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53663efa-c943-4452-b081-773080903577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.814793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c698fd6fc1344b7a6e40709a6d0b491'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.816845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53663efa-c943-4452-b081-773080903577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.831643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 846/1685] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:04 2021] DELETE /identity/v3/projects/3ed2d4c5a9874ace89374c1696479681 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:04.833781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df22a-4731-4a13-b745-cdc0e746318f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:04.834072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df22a-4731-4a13-b745-cdc0e746318f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:04.838353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278df22a-4731-4a13-b745-cdc0e746318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:04.846850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c698fd6fc1344b7a6e40709a6d0b491'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.848473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-256ddf15-5a57-48bd-8970-7cbeea54ebac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c698fd6fc1344b7a6e40709a6d0b491'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:04.864382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 840/1686] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:04 2021] DELETE /identity/v3/users/4c698fd6fc1344b7a6e40709a6d0b491 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:04.868095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:04.870573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:04.871196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:04.892962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:04.894511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:04.911249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-278df22a-4731-4a13-b745-cdc0e746318f None None] MFA Rules not processed for user `a1431bb04bd14db986edcf8931bc2210`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:04.912766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-278df22a-4731-4a13-b745-cdc0e746318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.023647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 841/1687] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:05.024646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.025976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.035579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 847/1688] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:04 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:05.038080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.038695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.039032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.048588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f00d-1793-4c74-836b-cb9176a85f4f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.060228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:05.061660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.065539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.066459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.066744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.067028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] PATH_INFO: `/v3/projects/6cbf89d2f37b4887a4cea2b93b4ec111` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.071259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 848/1689] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:05.072087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbf89d2f37b4887a4cea2b93b4ec111)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.072301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.073551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.073768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: WARNING py.warnings [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:05.073768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: warnings.warn(msg) Dec 15 13:04:05.073768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: Dec 15 13:04:05.075473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:05.184909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbf89d2f37b4887a4cea2b93b4ec111', 'request_id': 'req-147002a5-c1c9-4029-a8b2-61cfc127e01c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.207484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c01d8c-6f62-4bd4-a9c9-5868dee9d7d5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.208600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbf89d2f37b4887a4cea2b93b4ec111', 'request_id': 'req-147002a5-c1c9-4029-a8b2-61cfc127e01c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.219301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbf89d2f37b4887a4cea2b93b4ec111', 'request_id': 'req-147002a5-c1c9-4029-a8b2-61cfc127e01c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.235644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] The token cache is being invalidate because project 6cbf89d2f37b4887a4cea2b93b4ec111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:05.236280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.237083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.239167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 842/1690] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:05 2021] DELETE /identity/v3/projects/6cbf89d2f37b4887a4cea2b93b4ec111 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:05.244991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.246975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.309551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.314065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.314633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.315680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.318217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147002a5-c1c9-4029-a8b2-61cfc127e01c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.322808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.323692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.324568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.324999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.325617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.326600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:05.327024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.328989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429a8e8-ee84-4697-81a1-e4046a84f2d1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:05.342722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 843/1691] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:05.344169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.345517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.346231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.388710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:05.390040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.415313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 844/1692] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:05.416452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.442309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b7fc-e9c2-44f8-ad1c-2da5b31221ef None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.481656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.482710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.484250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.484536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.485818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.487313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:05.514122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.515933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e10e2-5c20-4079-95ef-7daae0e56c7f service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:05.528520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 845/1693] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:05 2021] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:05.529435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.535428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 849/1694] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:05 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:05.537400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.537686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.537961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.554008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.568709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:05.569924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.683476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f0619-8798-4ad6-984d-c20b9deba499 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.689297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.690243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.690527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.690803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] PATH_INFO: `/v3/projects/5a475a4d480a41129487d29b563c0a1f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.694089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a475a4d480a41129487d29b563c0a1f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.698131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:05.720978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 850/1695] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:05.721837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.744358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbaa7-43e4-4705-b73b-923957181a11 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.761333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a475a4d480a41129487d29b563c0a1f', 'request_id': 'req-dccafddd-256e-40bc-ba2e-fe2b5a771546'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.769056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a475a4d480a41129487d29b563c0a1f', 'request_id': 'req-dccafddd-256e-40bc-ba2e-fe2b5a771546'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.779862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a475a4d480a41129487d29b563c0a1f', 'request_id': 'req-dccafddd-256e-40bc-ba2e-fe2b5a771546'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.795821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] The token cache is being invalidate because project 5a475a4d480a41129487d29b563c0a1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:05.796395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.798166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:05.805567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 846/1696] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:05 2021] DELETE /identity/v3/projects/5a475a4d480a41129487d29b563c0a1f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:05.805567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.805850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.868166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4871c1-8411-4560-8e82-fd02aaff3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.868166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4871c1-8411-4560-8e82-fd02aaff3694 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.868166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4871c1-8411-4560-8e82-fd02aaff3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.868525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4871c1-8411-4560-8e82-fd02aaff3694 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.869015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4871c1-8411-4560-8e82-fd02aaff3694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.870962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4871c1-8411-4560-8e82-fd02aaff3694 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:05.897882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 851/1697] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:05 2021] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:05.899152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.899444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.899717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.932118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:05.935998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.962176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccafddd-256e-40bc-ba2e-fe2b5a771546 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:05.974337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 852/1698] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:05.974337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:05.974337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:05.990942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:05.991636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:05.991919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:05.992196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:05.992957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:05.993288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:05.995632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc5fc-0a07-4d6a-a39f-7db31fd76187 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.004802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbcc6b-e56f-414f-8819-b70fa1650bc6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.010374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.012092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.012092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.013016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.013945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.015721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.016059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 847/1699] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:06.020979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.021256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.021536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.028101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 853/1700] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:06.028941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.042869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7070ee9-0c79-4c42-8dbe-37d3876044fd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.048497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.049780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.050067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.050378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.051097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.053682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.063841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:06.067156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:06.091073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 854/1701] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:06.091415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 848/1702] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:06.092365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.092548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.112705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc151-3927-4c3b-a4c0-900f2dde7ede None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.231411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b1d35-174f-45e0-84c0-a95c22e0c151 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.238059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.238780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.239057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.240015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.253318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.253318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.269797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.270742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.271280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.271711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.272873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:06.273326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.276220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.278316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 855/1703] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:06 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:06.279261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.300506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09136ae1-4f1b-4a2a-bf3f-9122b168cdba admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.304345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 849/1704] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:06.305463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.320730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.321415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.321719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.321993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.322732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.324238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d273b-11af-4a75-9599-5b1272884927 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.324663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.340756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.341936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.342495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.343080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] PATH_INFO: `/v3/projects/65ec10fada1240edb5dc822aa72ffdd1/users/e6baac403f614eae83512331510b86aa/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.367247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 856/1705] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:06.368491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ec10fada1240edb5dc822aa72ffdd1, user_id=e6baac403f614eae83512331510b86aa, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.370945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.372435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.391703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 850/1706] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:06 2021] PUT /identity/v3/projects/65ec10fada1240edb5dc822aa72ffdd1/users/e6baac403f614eae83512331510b86aa/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:06.392922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.433502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072ed9c-0df4-4e6f-9ad8-ad2cd831bcf9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.553244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fdb4a-6f2a-4ad2-b619-9bc1ab37b274 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.559219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.559613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e217b3e-82b1-4039-a3eb-8cb760abfebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.560017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.560302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e217b3e-82b1-4039-a3eb-8cb760abfebf admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.560586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e217b3e-82b1-4039-a3eb-8cb760abfebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.560860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e217b3e-82b1-4039-a3eb-8cb760abfebf admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.561615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e217b3e-82b1-4039-a3eb-8cb760abfebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.563342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e217b3e-82b1-4039-a3eb-8cb760abfebf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.564227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.564628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.565979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.568128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.591231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 851/1707] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:06 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:06.592923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.593185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.593463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.625213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 857/1708] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:06.628698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.679636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] MFA Rules not processed for user `e6baac403f614eae83512331510b86aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:06.686120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:06.794392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1f2c2-1947-43f8-ac65-26753fbeff6a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.811694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.811694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.811694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.811694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.812084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.812084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.831736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 858/1709] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:06 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:06.838825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.851666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 852/1710] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:06.860455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.860920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a51247-b781-42f4-a27b-745dd87d9925 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.873893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.874328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.874609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.874881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.875589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.877506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.887923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c8ec-c11e-4e41-b55f-b74545f2677d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.893794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.894888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.895242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.896151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] PATH_INFO: `/v3/projects/f4ad59e1b54d4505a748bf2c55fc373a/users/f1078451d5f54a42b8692182f778b203/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.924169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 859/1711] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:06.924169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:06.929097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ad59e1b54d4505a748bf2c55fc373a, user_id=f1078451d5f54a42b8692182f778b203, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.937349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.943308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5cc7d-00b7-417d-a376-424f5a4fbd06 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:06.954366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcb46c-7ebf-423d-a981-77019333b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:06.955197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb46c-7ebf-423d-a981-77019333b395 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:06.955469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb46c-7ebf-423d-a981-77019333b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:06.955743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb46c-7ebf-423d-a981-77019333b395 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:06.956462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcb46c-7ebf-423d-a981-77019333b395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:06.958515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcb46c-7ebf-423d-a981-77019333b395 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:06.964469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 853/1712] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:06 2021] PUT /identity/v3/projects/f4ad59e1b54d4505a748bf2c55fc373a/users/f1078451d5f54a42b8692182f778b203/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:06.967951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.018938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 860/1713] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:06 2021] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:07.020326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.020742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.020944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.062880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] MFA Rules not processed for user `f1078451d5f54a42b8692182f778b203`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:07.064529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:07.086844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728b50-64bc-430e-aa08-b4a45e1e8916 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.167954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 861/1714] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:07.169048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.178911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.179652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.180097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.180379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.181126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.183267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.199173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 854/1715] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:06 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:07.199173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.211112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1edb5e-c2ee-42a3-b4b4-84f384b0f6b3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.217811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.218382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.218662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.218934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.219911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.222357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.271024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 855/1716] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:07 2021] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:07.275643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.316254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a03f99-5552-4cff-bb21-e317403d9ec2 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.435949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.438227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.438652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.439059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.440606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.443154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.482657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd81c7-e648-4790-9266-eff51a895e6c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.485900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 862/1717] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:07 2021] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:07.487335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.496638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.499083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.500172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.503365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.507224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.507994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b71d-fb27-4a17-b3aa-1f88f81a6967 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.512175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.513918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.514781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.515182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.515522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.516357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.518698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.541861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 856/1718] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:07.545185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.564792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 863/1719] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:07 2021] POST /identity/v3/users => generated 295 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:07.567050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.572196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e09839-e07b-433a-a794-861c384038aa admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.585920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.586780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.587107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.587384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.589095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.592291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.603217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0d4a2-38d9-4b74-aa30-03c48e92ad3e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.612525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 857/1720] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:07.613682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.615427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.615693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.616171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.616678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] PATH_INFO: `/v3/projects/b01731cf990347558fb16b792a84e5ca/users/8cf4f873a621491c8a41b30b2e1e365b/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.640637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c57c5-cd13-4f2b-85e6-c095df779c20 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.654359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.655163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.655503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.655847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.656669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.662629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.663434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01731cf990347558fb16b792a84e5ca, user_id=8cf4f873a621491c8a41b30b2e1e365b, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:07.667814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:07.690884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 864/1721] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:07 2021] PUT /identity/v3/projects/b01731cf990347558fb16b792a84e5ca/users/8cf4f873a621491c8a41b30b2e1e365b/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:07.694381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.699609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 858/1722] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:07.702805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:07.724591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cb9e-a3fa-4fde-8309-f22b8ad90141 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.924103 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57788-d1ea-4978-94a5-7b660b984ec5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:07.963925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876421-e92a-4014-bbf7-59d142739596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.964869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876421-e92a-4014-bbf7-59d142739596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.965192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876421-e92a-4014-bbf7-59d142739596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.966116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876421-e92a-4014-bbf7-59d142739596 admin admin] PATH_INFO: `/v3/projects/5c0273c1dfd045aa88ded7931550d8f3/users/37ea221bceb64ac19221bbd17edbb81e/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:07.982954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:07.983875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:07.984165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:07.984528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] PATH_INFO: `/v3/projects/2aeb7accb2d04acd997a07b6ef57c872/users/97e36c4c47e849fca55e742249987d66/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:08.012710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876421-e92a-4014-bbf7-59d142739596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0273c1dfd045aa88ded7931550d8f3, user_id=37ea221bceb64ac19221bbd17edbb81e, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:08.015466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876421-e92a-4014-bbf7-59d142739596 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:08.029682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aeb7accb2d04acd997a07b6ef57c872, user_id=97e36c4c47e849fca55e742249987d66, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:08.032354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:08.051545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 865/1723] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:07 2021] PUT /identity/v3/projects/5c0273c1dfd045aa88ded7931550d8f3/users/37ea221bceb64ac19221bbd17edbb81e/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:08.060470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:08.060764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:08.061042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:08.078817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 859/1724] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:07 2021] PUT /identity/v3/projects/2aeb7accb2d04acd997a07b6ef57c872/users/97e36c4c47e849fca55e742249987d66/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:08.079866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:08.167954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] MFA Rules not processed for user `8cf4f873a621491c8a41b30b2e1e365b`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:08.170175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:08.344477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d79dd-3d86-4182-956b-eb386274e134 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:08.362927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58f415-5a58-48ec-8da8-79d3a656764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:08.366215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58f415-5a58-48ec-8da8-79d3a656764b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:08.366498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58f415-5a58-48ec-8da8-79d3a656764b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:08.370903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58f415-5a58-48ec-8da8-79d3a656764b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:08.372185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58f415-5a58-48ec-8da8-79d3a656764b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:08.378837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58f415-5a58-48ec-8da8-79d3a656764b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:08.412378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 866/1725] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:08.413781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:08.452873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 860/1726] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:08 2021] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:08.454213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b4ca4-a5c3-4057-a6f8-8b4e7582ff07 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:08.458695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:08.459188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:08.460296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:08.491065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:08.491766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:08.492045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:08.492317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:08.493071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:08.494727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:08.535453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:08.541706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:08.556686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 867/1727] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:08 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:08.561802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:08.597708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7bcc-347c-4455-bc04-12c38f81292c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:08.641176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:08.641846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:08.642130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:08.642446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:08.643172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:08.645186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:08.730172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 868/1728] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:08 2021] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:08.731104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:08.759571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 861/1729] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:04:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:08.761418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:08.830479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42b8d-8bf9-4bd6-8803-d15d4995f2d3 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:08.977050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f67682-0bb3-40d2-af91-3143794ff335 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:08.999500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:08.999712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.000042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.000444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] PATH_INFO: `/v3/projects/5c0273c1dfd045aa88ded7931550d8f3/users/37ea221bceb64ac19221bbd17edbb81e/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.021797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0273c1dfd045aa88ded7931550d8f3, user_id=37ea221bceb64ac19221bbd17edbb81e, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:09.025748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:09.073458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 869/1730] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:08 2021] PUT /identity/v3/projects/5c0273c1dfd045aa88ded7931550d8f3/users/37ea221bceb64ac19221bbd17edbb81e/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:09.074487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:09.101895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d3fc6-20b5-47ed-96fc-eb76a7441c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:09.104204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3fc6-20b5-47ed-96fc-eb76a7441c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.105821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3fc6-20b5-47ed-96fc-eb76a7441c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.107746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d3fc6-20b5-47ed-96fc-eb76a7441c17 admin admin] PATH_INFO: `/v3/projects/2aeb7accb2d04acd997a07b6ef57c872/users/97e36c4c47e849fca55e742249987d66/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.113583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3fc6-20b5-47ed-96fc-eb76a7441c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aeb7accb2d04acd997a07b6ef57c872, user_id=97e36c4c47e849fca55e742249987d66, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:09.126223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d3fc6-20b5-47ed-96fc-eb76a7441c17 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:09.157147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 862/1731] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:08 2021] PUT /identity/v3/projects/2aeb7accb2d04acd997a07b6ef57c872/users/97e36c4c47e849fca55e742249987d66/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:09.179875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e50f93-223a-4d03-a7cb-3c6325b8171d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.180165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e50f93-223a-4d03-a7cb-3c6325b8171d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.181403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e50f93-223a-4d03-a7cb-3c6325b8171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.228442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d47e-cfdb-496e-bc99-cb54b5e57deb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:09.271348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b6e50f93-223a-4d03-a7cb-3c6325b8171d None None] MFA Rules not processed for user `37ea221bceb64ac19221bbd17edbb81e`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:09.274252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b6e50f93-223a-4d03-a7cb-3c6325b8171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:09.306499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:09.307395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.307772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.308139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.308955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:09.311740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:09.350816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 870/1732] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:09 2021] POST /identity/v3/users => generated 299 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:09.352988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:09.359192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:09.461511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 863/1733] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:09 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:09.463258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.463550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.463826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.494798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf6e61-ee75-406e-be69-36fd76a49f8f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:09.510715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:09.511792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.512223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.512643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.536556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] MFA Rules not processed for user `97e36c4c47e849fca55e742249987d66`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:09.539119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:09.700286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 864/1734] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:09 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:09.701320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:09.716823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103572-bd42-46b4-8139-2e44a4544d8c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:09.718384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:09.720090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:09.725367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522226d-7684-46d5-9f66-5fd3baf06bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:09.726348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522226d-7684-46d5-9f66-5fd3baf06bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.726818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522226d-7684-46d5-9f66-5fd3baf06bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.727945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522226d-7684-46d5-9f66-5fd3baf06bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.729179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522226d-7684-46d5-9f66-5fd3baf06bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:09.731760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522226d-7684-46d5-9f66-5fd3baf06bd1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:09.744423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 871/1735] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:04:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:04:09.745353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:09.748282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 865/1736] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:09.750535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.751386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.752638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.774442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad0e71-2220-4a82-814a-20545bf4a041 service swift] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:09.789067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:09.790113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:09.790312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:09.790589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] PATH_INFO: `/v3/users/e6baac403f614eae83512331510b86aa` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:09.791913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6baac403f614eae83512331510b86aa)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:09.792929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: WARNING py.warnings [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 15 13:04:09.792929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: warnings.warn(msg) Dec 15 13:04:09.792929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: Dec 15 13:04:09.794324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:09.829776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] MFA Rules not processed for user `ff7f1cc9a2214907871542822081375f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:09.831748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:10.030738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6baac403f614eae83512331510b86aa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:10.062917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6baac403f614eae83512331510b86aa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:10.116424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6baac403f614eae83512331510b86aa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:10.123070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6baac403f614eae83512331510b86aa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:10.128680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 866/1737] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:09 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:10.130138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:10.142602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:10.258853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6baac403f614eae83512331510b86aa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:10.273520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 872/1738] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:09 2021] DELETE /identity/v3/users/e6baac403f614eae83512331510b86aa => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:10.275173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:10.278775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:10.420270 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d52700-79f5-486e-9a10-3a1f6c117fc6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:10.529436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02426088-8bc2-4eff-9389-3fe2a6e11d03 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:10.543045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:10.545716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:10.545998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:10.546302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] PATH_INFO: `/v3/projects/9d1d19a63de04584bd3661b0d1d09b20/users/d8d5d45ae4e9491a84cd8b38a9a860fe/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:10.582559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d19a63de04584bd3661b0d1d09b20, user_id=d8d5d45ae4e9491a84cd8b38a9a860fe, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:10.585771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:10.611566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:10.612253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:10.612526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:10.613503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:10.617775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 873/1739] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:10 2021] PUT /identity/v3/projects/9d1d19a63de04584bd3661b0d1d09b20/users/d8d5d45ae4e9491a84cd8b38a9a860fe/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:10.618303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:10.622139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:10.622438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:10.806233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6f2f-b6dd-4109-92e6-fd4b787b703a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:10.813574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:10.814407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:10.814756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:10.815329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:10.818006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:10.849039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:10.853449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a6d9a-eb45-410e-b10e-6eae0da6caad service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:10.919901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 867/1740] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:10.923972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:10.929651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:10.930871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:10.953267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:10.955736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:10.985898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 874/1741] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:10.989213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:11.027958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:11.029572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:11.372416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6ff49-758e-4741-bf78-88fd18148682 service nova] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:11.381480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 868/1742] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:11.390284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:11.394545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:11.394758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:11.398664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:11.399496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:11.410509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:11.462564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 875/1743] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:11.463941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:11.486177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c141b-17d6-4528-b2f2-a324b0070480 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:11.524208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce51b0c-00f5-4b60-bbc7-029c498b198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:11.532138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51b0c-00f5-4b60-bbc7-029c498b198d admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:11.540846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51b0c-00f5-4b60-bbc7-029c498b198d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:11.541136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51b0c-00f5-4b60-bbc7-029c498b198d admin admin] PATH_INFO: `/v3/projects/9d1d19a63de04584bd3661b0d1d09b20/users/d8d5d45ae4e9491a84cd8b38a9a860fe/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:11.554461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:11.556886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:11.569980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51b0c-00f5-4b60-bbc7-029c498b198d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d19a63de04584bd3661b0d1d09b20, user_id=d8d5d45ae4e9491a84cd8b38a9a860fe, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:11.599907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51b0c-00f5-4b60-bbc7-029c498b198d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:11.684516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 869/1744] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:11 2021] PUT /identity/v3/projects/9d1d19a63de04584bd3661b0d1d09b20/users/d8d5d45ae4e9491a84cd8b38a9a860fe/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:11.692730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ce5a-3bb3-482f-9898-0b8fabfdd81c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:11.697626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ce5a-3bb3-482f-9898-0b8fabfdd81c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:11.697985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82ce5a-3bb3-482f-9898-0b8fabfdd81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:11.841330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0f82ce5a-3bb3-482f-9898-0b8fabfdd81c None None] MFA Rules not processed for user `d8d5d45ae4e9491a84cd8b38a9a860fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:11.842879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0f82ce5a-3bb3-482f-9898-0b8fabfdd81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:11.892197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906d8e5-64d0-4999-9b7c-353654e99ab7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:12.078626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:12.080441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:12.080738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:12.081504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:12.139636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 870/1745] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:11 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:12.142415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:12.142705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:12.142984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:12.209952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] MFA Rules not processed for user `6300d566628547b48cbe60769799c1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:12.212886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:12.235776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 871/1746] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Dec 15 13:04:12 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:12.240180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:12.242461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:12.323292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:12.329547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:12.359611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 876/1747] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 806 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:12.363177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:12.395425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcfbee-cf52-4ea1-ba8d-2062a5f433e8 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:12.406550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:12.407292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:12.407779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:12.407986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:12.432701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70d653-35ac-4057-a538-b8bd1a37d2c1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:12.435644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:12.437088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:12.444803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329e36-1ca6-4cfa-bb03-9fc971498038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:12.445468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329e36-1ca6-4cfa-bb03-9fc971498038 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:12.445779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329e36-1ca6-4cfa-bb03-9fc971498038 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:12.446065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329e36-1ca6-4cfa-bb03-9fc971498038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:12.459568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 877/1748] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:12.463845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329e36-1ca6-4cfa-bb03-9fc971498038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:12.465389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329e36-1ca6-4cfa-bb03-9fc971498038 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:12.488200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 872/1749] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:12 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:12.960998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:12.963401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:13.008535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f46202-9f38-4b64-bba8-397afe70eb04 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:13.034314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:13.035578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:13.038707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:13.041385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] PATH_INFO: `/v3/users/63f71308767b4b21bd8f2ad7f68999c9` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:13.044857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f71308767b4b21bd8f2ad7f68999c9)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:13.049761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:13.128650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f71308767b4b21bd8f2ad7f68999c9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:13.143546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f71308767b4b21bd8f2ad7f68999c9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:13.165398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f71308767b4b21bd8f2ad7f68999c9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:13.168005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f71308767b4b21bd8f2ad7f68999c9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:13.202257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f71308767b4b21bd8f2ad7f68999c9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:13.214243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 878/1750] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:12 2021] DELETE /identity/v3/users/63f71308767b4b21bd8f2ad7f68999c9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:13.218497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:13.219020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:13.219020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:13.266455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:13.269640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:13.379384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 873/1751] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:13.486583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:13.488651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:13.695495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8f492-261f-4a5b-aebe-5a60e884af8b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:13.709637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:13.715195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:13.716323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:13.716323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:13.742525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:13.744231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:13.797823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 879/1752] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:14.008137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:14.009827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:14.068901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74488b-0869-4f6f-a1b4-365aa9fc3768 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:14.079588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:14.082726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:14.083980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:14.084480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] PATH_INFO: `/v3/users/8cf4f873a621491c8a41b30b2e1e365b` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:14.086220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf4f873a621491c8a41b30b2e1e365b)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:14.091333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:14.150379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:14.153992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:14.193471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e76c0-6f64-4096-a74e-d141947b9404 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:14.210104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf4f873a621491c8a41b30b2e1e365b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.217043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:14.221678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:14.222015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:14.222328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] PATH_INFO: `/v3/projects/65ec10fada1240edb5dc822aa72ffdd1` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:14.231269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ec10fada1240edb5dc822aa72ffdd1)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:14.233469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:14.261095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf4f873a621491c8a41b30b2e1e365b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.295908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf4f873a621491c8a41b30b2e1e365b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.358200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf4f873a621491c8a41b30b2e1e365b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.358961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f0069a74-ff84-48df-8774-4e63db82354c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf4f873a621491c8a41b30b2e1e365b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.371996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 874/1753] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:14 2021] DELETE /identity/v3/users/8cf4f873a621491c8a41b30b2e1e365b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:14.376548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:14.376839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:14.377119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:14.383685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ec10fada1240edb5dc822aa72ffdd1', 'request_id': 'req-6788bb4f-67ca-4451-9cc4-013445e6b58a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.394121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ec10fada1240edb5dc822aa72ffdd1', 'request_id': 'req-6788bb4f-67ca-4451-9cc4-013445e6b58a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.408247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ec10fada1240edb5dc822aa72ffdd1', 'request_id': 'req-6788bb4f-67ca-4451-9cc4-013445e6b58a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.421416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:14.425932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:14.449146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] The token cache is being invalidate because project 65ec10fada1240edb5dc822aa72ffdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:14.449616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.450832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.457195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 880/1754] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:14 2021] DELETE /identity/v3/projects/65ec10fada1240edb5dc822aa72ffdd1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:14.461897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:14.467131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:14.548713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 875/1755] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:14.591372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788bb4f-67ca-4451-9cc4-013445e6b58a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:14.598081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:14.599616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:14.600050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:14.600479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] PATH_INFO: `/v3/users/37ea221bceb64ac19221bbd17edbb81e` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:14.602686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ea221bceb64ac19221bbd17edbb81e)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:14.605083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:14.613899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:14.616443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:14.764141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ea221bceb64ac19221bbd17edbb81e'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.783607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ea221bceb64ac19221bbd17edbb81e'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.806753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ea221bceb64ac19221bbd17edbb81e'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.806929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7efaf-3d93-45f5-b14b-d2030517c926 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:14.807432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ea221bceb64ac19221bbd17edbb81e'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.816732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953b330-362d-436a-9eeb-853e55ba4b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:14.818713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b330-362d-436a-9eeb-853e55ba4b51 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:14.819058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b330-362d-436a-9eeb-853e55ba4b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:14.819372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953b330-362d-436a-9eeb-853e55ba4b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:14.837614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-f3e64eef-1b73-46ef-b102-46b494ea7e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ea221bceb64ac19221bbd17edbb81e'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:14.848381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953b330-362d-436a-9eeb-853e55ba4b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:14.849955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953b330-362d-436a-9eeb-853e55ba4b51 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:14.855865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 881/1756] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:14 2021] DELETE /identity/v3/users/37ea221bceb64ac19221bbd17edbb81e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:14.869605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 876/1757] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:14.960225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ff7-4347-4c04-baef-fbd2c7634d26 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:14.960792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ff7-4347-4c04-baef-fbd2c7634d26 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:14.961179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9150ff7-4347-4c04-baef-fbd2c7634d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:14.991489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c9150ff7-4347-4c04-baef-fbd2c7634d26 None None] MFA Rules not processed for user `a1431bb04bd14db986edcf8931bc2210`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:14.993116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c9150ff7-4347-4c04-baef-fbd2c7634d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:15.112779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 882/1758] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:14 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:15.621331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5f26c-5e8d-42ff-9c1e-c2cc84374c64 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:15.622876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5f26c-5e8d-42ff-9c1e-c2cc84374c64 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:15.623393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5f26c-5e8d-42ff-9c1e-c2cc84374c64 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:15.628382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 877/1759] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 13:04:15 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:04:15.652829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:15.653797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:15.654305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:15.714355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:15.719688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:15.823530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 883/1760] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 13:04:15 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:16.155210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5f26c-5e8d-42ff-9c1e-c2cc84374c64 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:16.158320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b3b5f26c-5e8d-42ff-9c1e-c2cc84374c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:16.180203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:16.182068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:16.344536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5f26c-5e8d-42ff-9c1e-c2cc84374c64 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:16.351451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:16.352540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:16.353029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:16.353402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] PATH_INFO: `/v3/projects/593ba127331047e78564382ed40c9a6c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:16.355446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] RBAC: Authorizing `identity:delete_project(project_id=593ba127331047e78564382ed40c9a6c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:16.358216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:16.454116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126514c-c213-41f6-a6a8-8d47feef6872 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:16.480712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593ba127331047e78564382ed40c9a6c', 'request_id': 'req-4f5f2c00-8e19-4e09-be06-d176517e44af'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.498502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593ba127331047e78564382ed40c9a6c', 'request_id': 'req-4f5f2c00-8e19-4e09-be06-d176517e44af'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.513956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593ba127331047e78564382ed40c9a6c', 'request_id': 'req-4f5f2c00-8e19-4e09-be06-d176517e44af'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.536879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] The token cache is being invalidate because project 593ba127331047e78564382ed40c9a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:16.537428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.538990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.544123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 878/1761] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:16 2021] DELETE /identity/v3/projects/593ba127331047e78564382ed40c9a6c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:16.553635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:16.556474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:16.581856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:16.583640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:16.584144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:16.584629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] PATH_INFO: `/v3/projects/5c0273c1dfd045aa88ded7931550d8f3` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:16.586263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0273c1dfd045aa88ded7931550d8f3)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:16.589727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:16.704916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0273c1dfd045aa88ded7931550d8f3', 'request_id': 'req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.716550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0273c1dfd045aa88ded7931550d8f3', 'request_id': 'req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.732923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0273c1dfd045aa88ded7931550d8f3', 'request_id': 'req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.758582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f2c00-8e19-4e09-be06-d176517e44af admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:16.759165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] The token cache is being invalidate because project 5c0273c1dfd045aa88ded7931550d8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:16.759366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.760132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cbfa07e3-07ba-42e9-bbe6-0b81221385a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:16.766721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 884/1762] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:16 2021] DELETE /identity/v3/projects/5c0273c1dfd045aa88ded7931550d8f3 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:16.768601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:16.768998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:16.769377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:16.831829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:16.834442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:16.940281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:16.941256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:16.942699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:16.942986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] PATH_INFO: `/v3/users/bc07ae59fc2346f0b1a5089485b86239` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:16.946700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc07ae59fc2346f0b1a5089485b86239)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:16.952068 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:17.030343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 885/1763] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:17.030343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:17.030343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:17.056234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc07ae59fc2346f0b1a5089485b86239'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.078684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc07ae59fc2346f0b1a5089485b86239'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.107585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc07ae59fc2346f0b1a5089485b86239'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.143642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc07ae59fc2346f0b1a5089485b86239'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.147526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e6306ac7-1852-4ea4-8d7d-faf7f6d23a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc07ae59fc2346f0b1a5089485b86239'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.161875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 879/1764] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:16 2021] DELETE /identity/v3/users/bc07ae59fc2346f0b1a5089485b86239 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:17.163598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.163893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.164261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.234421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:17.235955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:17.268616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bf3f0-725a-426d-9dc0-b0d7e6da6120 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:17.372092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 880/1765] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:17.373079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:17.376746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:17.416743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649ff3-c5f9-4a07-ac69-619183538280 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:17.427364 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:17.430699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.431006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.434815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] PATH_INFO: `/v3/projects/b01731cf990347558fb16b792a84e5ca` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.442456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01731cf990347558fb16b792a84e5ca)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:17.442784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:17.444146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.445631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.446017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.446994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:17.459051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:17.499141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:17.501202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:17.543855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 886/1766] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:17.544968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:17.568545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01731cf990347558fb16b792a84e5ca', 'request_id': 'req-647c0169-0769-4a45-a73a-6bde6ccd0509'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.590275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23853cdb-7bbc-4405-8ab0-31ff9490e4f0 service nova] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:17.599775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01731cf990347558fb16b792a84e5ca', 'request_id': 'req-647c0169-0769-4a45-a73a-6bde6ccd0509'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.621297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01731cf990347558fb16b792a84e5ca', 'request_id': 'req-647c0169-0769-4a45-a73a-6bde6ccd0509'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.653127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] The token cache is being invalidate because project b01731cf990347558fb16b792a84e5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:17.653423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.662399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:17.666770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 881/1767] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:17 2021] DELETE /identity/v3/projects/b01731cf990347558fb16b792a84e5ca => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:17.670352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:17.674589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:17.781125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:17.782752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.783256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.783745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.784922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:17.785481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:17.787432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcf45d-f7c7-4559-8139-9ada79b190d9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:17.851696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 887/1768] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:17.853415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ffa1a-06e8-4400-86db-c77e12b7dd91 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.856062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ffa1a-06e8-4400-86db-c77e12b7dd91 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.856664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ffa1a-06e8-4400-86db-c77e12b7dd91 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.858739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 888/1769] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 13:04:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:04:17.870888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ffa1a-06e8-4400-86db-c77e12b7dd91 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:17.873083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-696ffa1a-06e8-4400-86db-c77e12b7dd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:17.895975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ffa1a-06e8-4400-86db-c77e12b7dd91 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:17.910890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11cefb-4315-45de-aac3-89c92354593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:17.911988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11cefb-4315-45de-aac3-89c92354593e admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.912488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11cefb-4315-45de-aac3-89c92354593e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.912995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11cefb-4315-45de-aac3-89c92354593e admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.914542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11cefb-4315-45de-aac3-89c92354593e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:17.916837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11cefb-4315-45de-aac3-89c92354593e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:17.970601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 889/1770] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:17 2021] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:17.980543 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:17.983361 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:17.983967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:17.987280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c0169-0769-4a45-a73a-6bde6ccd0509 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:18.030576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:18.038570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:18.236193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:18.245433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:18.247864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:18.248276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] PATH_INFO: `/v3/users/d8d5d45ae4e9491a84cd8b38a9a860fe` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:18.259934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d5d45ae4e9491a84cd8b38a9a860fe)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:18.268413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:18.429490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 890/1771] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 13:04:17 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:18.430578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:18.471896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1210e3-0cc0-4bd2-b302-32ce5defd3a2 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:18.479496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d5d45ae4e9491a84cd8b38a9a860fe'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:18.495639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:18.496888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:18.497176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:18.497455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:18.499578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:18.500201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d5d45ae4e9491a84cd8b38a9a860fe'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:18.504635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:18.524315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d5d45ae4e9491a84cd8b38a9a860fe'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:18.557832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 891/1772] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:18 2021] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:18.567450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:18.568767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d5d45ae4e9491a84cd8b38a9a860fe'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:18.571218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d5d45ae4e9491a84cd8b38a9a860fe'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:18.574658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:18.588209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 882/1773] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:17 2021] DELETE /identity/v3/users/d8d5d45ae4e9491a84cd8b38a9a860fe => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:18.589415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:18.592363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:18.756758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8739e3f-d90f-4d50-a05e-1617c40d7e45 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:18.764081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:18.765037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:18.765795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:18.766279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:18.768374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:18.768801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4827e-edb5-40d9-8fab-035646c3cdab admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:18.771314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:18.806707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 883/1774] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:18.808192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:18.837030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6059e03-bac0-48eb-bf73-b76f0c5558cb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:18.843493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:18.845489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:18.846331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:18.847934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:18.851240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:18.857475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:18.888817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:18.889422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:18.891382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:18.891826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:18.891945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 884/1775] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:18.896935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:18.898993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:18.920876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b0cf-0dae-44ec-a29b-7d3cfa268995 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:18.937513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:18.938952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:18.939782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:18.940236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] PATH_INFO: `/v3/projects/586fa5260c6e46238035116c3568b194/users/0dc70032bca149e09b3b02f33e603452/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:18.976149 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586fa5260c6e46238035116c3568b194, user_id=0dc70032bca149e09b3b02f33e603452, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:18.981138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.032168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 885/1776] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:18 2021] PUT /identity/v3/projects/586fa5260c6e46238035116c3568b194/users/0dc70032bca149e09b3b02f33e603452/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:19.033284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:19.040448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:19.090624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:19.091711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d9c7f-60be-4d0a-8818-a6449fc40a95 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.115402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 892/1777] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:18 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:19.126828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.137242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.138180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:19.200796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e5050-7a98-4c3c-a342-4c6719356584 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:19.210578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] MFA Rules not processed for user `0dc70032bca149e09b3b02f33e603452`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:19.212119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:19.213842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:19.214835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.215525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.216079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:19.222999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:19.252977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:19.255960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.295693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 886/1778] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:19 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:19.360732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 893/1779] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:19 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:19.366510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:19.513578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1215-20e5-48c6-b6de-7c676291e897 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:19.519856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:19.520561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.521015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.521304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:19.523291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:19.525552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.578033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:19.583546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 887/1780] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:19 2021] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:19.605291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310253b-f312-478c-a934-b313cea4ebcc None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:19.767262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:19.768709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.769600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.769993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:19.771746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:19.776241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.826120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 894/1781] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:19 2021] POST /identity/v3/users => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:19.830783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:19.851952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:19.853272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8774d-a6be-47eb-9b52-a83000102373 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:19.853854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:19.866230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:19.866573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.866805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.867099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:19.867859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:19.869470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.883867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c5b92-02e4-4830-ba36-ec2c4a508d6f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:19.892515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 888/1782] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:19 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:19.895598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:19.896484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.896759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.897292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] PATH_INFO: `/v3/projects/57a036522d38489b8de665d91dc382ff` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:19.902867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:19.903016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a036522d38489b8de665d91dc382ff)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:19.907635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:19.927549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe94ce-e09b-4890-aa99-9e03ba56c1b7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:19.953125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48acfa-40ff-496f-86dc-a5dcedf3b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:19.954917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48acfa-40ff-496f-86dc-a5dcedf3b48f admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:19.955203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48acfa-40ff-496f-86dc-a5dcedf3b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:19.955481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48acfa-40ff-496f-86dc-a5dcedf3b48f admin admin] PATH_INFO: `/v3/projects/2874736a9a844af8837a26e1ce21719b/users/a2742c97abac48a8965a613e2e82782e/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.002717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48acfa-40ff-496f-86dc-a5dcedf3b48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2874736a9a844af8837a26e1ce21719b, user_id=a2742c97abac48a8965a613e2e82782e, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.011582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48acfa-40ff-496f-86dc-a5dcedf3b48f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.045759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 889/1783] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:19 2021] PUT /identity/v3/projects/2874736a9a844af8837a26e1ce21719b/users/a2742c97abac48a8965a613e2e82782e/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:20.049248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3435f-279a-46b5-bf85-843097f01e2d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.049615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3435f-279a-46b5-bf85-843097f01e2d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.049998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3435f-279a-46b5-bf85-843097f01e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.056328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a036522d38489b8de665d91dc382ff', 'request_id': 'req-b31d9d4f-7281-481d-8963-61e41918ea64'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.067792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a036522d38489b8de665d91dc382ff', 'request_id': 'req-b31d9d4f-7281-481d-8963-61e41918ea64'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.079600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a036522d38489b8de665d91dc382ff', 'request_id': 'req-b31d9d4f-7281-481d-8963-61e41918ea64'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.083617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-25a3435f-279a-46b5-bf85-843097f01e2d None None] MFA Rules not processed for user `ff7f1cc9a2214907871542822081375f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:20.084963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-25a3435f-279a-46b5-bf85-843097f01e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.096729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] The token cache is being invalidate because project 57a036522d38489b8de665d91dc382ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:20.097425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.099856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.102019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 895/1784] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:19 2021] DELETE /identity/v3/projects/57a036522d38489b8de665d91dc382ff => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:20.103018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.104933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.207613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 890/1785] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:20.208735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.209016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.209292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.248822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:20.254073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.272428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d9d4f-7281-481d-8963-61e41918ea64 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.355857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 891/1786] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:20.356798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.358241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.372833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e8f7-7241-4e56-b099-d3ee233ebffd None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.386334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.387015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.387168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.387313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.387588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.387903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.388333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.388487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.388619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] PATH_INFO: `/v3/projects/9d1d19a63de04584bd3661b0d1d09b20` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.390547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.390720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1d19a63de04584bd3661b0d1d09b20)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.393010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.404754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 896/1787] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:20.405725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.415737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdfd17-007c-4a52-83c2-194edd1a255d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.420643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577d141-e5d6-4f8a-93e4-2503936846cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.421528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d141-e5d6-4f8a-93e4-2503936846cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.421805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d141-e5d6-4f8a-93e4-2503936846cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.422549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577d141-e5d6-4f8a-93e4-2503936846cf admin admin] PATH_INFO: `/v3/projects/2874736a9a844af8837a26e1ce21719b/users/a2742c97abac48a8965a613e2e82782e/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.424346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d141-e5d6-4f8a-93e4-2503936846cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2874736a9a844af8837a26e1ce21719b, user_id=a2742c97abac48a8965a613e2e82782e, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.427354 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577d141-e5d6-4f8a-93e4-2503936846cf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.441377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 897/1788] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:20 2021] PUT /identity/v3/projects/2874736a9a844af8837a26e1ce21719b/users/a2742c97abac48a8965a613e2e82782e/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:20.451978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1d19a63de04584bd3661b0d1d09b20', 'request_id': 'req-c0705c43-86d4-4651-871a-6840b73479d0'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.452644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702287-2675-479e-ba35-408340503679 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.453035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702287-2675-479e-ba35-408340503679 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.454008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702287-2675-479e-ba35-408340503679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.459064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1d19a63de04584bd3661b0d1d09b20', 'request_id': 'req-c0705c43-86d4-4651-871a-6840b73479d0'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.471221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1d19a63de04584bd3661b0d1d09b20', 'request_id': 'req-c0705c43-86d4-4651-871a-6840b73479d0'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.476419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-76702287-2675-479e-ba35-408340503679 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:20.477630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-76702287-2675-479e-ba35-408340503679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.486629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] The token cache is being invalidate because project 9d1d19a63de04584bd3661b0d1d09b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:20.487442 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.487947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c0705c43-86d4-4651-871a-6840b73479d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.490129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 892/1789] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:20 2021] DELETE /identity/v3/projects/9d1d19a63de04584bd3661b0d1d09b20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:20.491668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601144d-98ea-40ff-b4b2-131f1c10d06a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.492091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601144d-98ea-40ff-b4b2-131f1c10d06a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.492655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601144d-98ea-40ff-b4b2-131f1c10d06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.532695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5601144d-98ea-40ff-b4b2-131f1c10d06a None None] MFA Rules not processed for user `a2742c97abac48a8965a613e2e82782e`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:20.534051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5601144d-98ea-40ff-b4b2-131f1c10d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.549698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 898/1790] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:20.551788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.552143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.552491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.574957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:20.576171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.587091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 899/1791] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:20.588219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.599934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af918f4-47ba-41d8-be60-fbaa3b9fc08d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.605458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.606231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.606590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.607073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.607991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:20.608323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.610069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.624999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 893/1792] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:20.624999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.624999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.624999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.628742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 900/1793] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:20.634362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.636673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.656331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:20.658100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.675140 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 894/1794] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:20.679139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.694202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c36c-fb2f-49e5-bb14-a190666011a1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.699735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.700645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.701179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.701638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.702562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.704807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.718727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a83972-1316-4693-b147-85e637582224 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.722558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.723317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.723673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.724010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.736148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.737801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.747151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 895/1795] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:20.747151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.761256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 901/1796] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:20 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:20.762221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.776394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11433cea-2215-4c7c-926b-df550efcac6e service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.849997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.850729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.851011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.851290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.852001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.853948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.867222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a7b91-df75-4a2a-8528-4c9888989806 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.873607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.875545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.876036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.876487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.877420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:20.877897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.879761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.880208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 902/1797] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:20.884430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.886600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:20.895930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 896/1798] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:20.897472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.903341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7902e-5264-47fd-811f-04c732eb671a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.908425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.909206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9abb91-20d7-4e5d-8a46-153eaaacf064 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.909319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.909600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.909873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] PATH_INFO: `/v3/users/0dc70032bca149e09b3b02f33e603452` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.911757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc70032bca149e09b3b02f33e603452)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.913690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.914661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.915350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.915742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.916485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.917007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.918641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.933577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 897/1799] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:20.934853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:20.948893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd66a0-b68b-4aee-b987-81144bbeea0a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:20.955846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:20.957671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:20.958006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:20.958433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:20.959387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:20.961859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:20.972150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc70032bca149e09b3b02f33e603452'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.983718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc70032bca149e09b3b02f33e603452'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:20.997888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 898/1800] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:20 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:20.997888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.000699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc70032bca149e09b3b02f33e603452'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:21.001469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc70032bca149e09b3b02f33e603452'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:21.014065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc70032bca149e09b3b02f33e603452'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:21.025190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 903/1801] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:20 2021] DELETE /identity/v3/users/0dc70032bca149e09b3b02f33e603452 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:21.026399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.028733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:21.096335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969b459-105d-460b-a11a-87c360cc4b60 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.178281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37279a-19aa-4c24-a76c-019d7fca3044 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.185469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.186701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.187095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.187657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.188525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.190670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.200837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ecc8-b4a3-45b0-8834-9f1c8ca1011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.201511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ecc8-b4a3-45b0-8834-9f1c8ca1011b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.201794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ecc8-b4a3-45b0-8834-9f1c8ca1011b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.202071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ecc8-b4a3-45b0-8834-9f1c8ca1011b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.202935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52ecc8-b4a3-45b0-8834-9f1c8ca1011b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.204526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52ecc8-b4a3-45b0-8834-9f1c8ca1011b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.222529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 899/1802] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:20 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:21.224507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.224825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.225443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.238465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 904/1803] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:21 2021] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:21.239301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.241066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:21.258744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40da78f-15bb-4907-84cf-232f08e50c71 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.269363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.271091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.271383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.273801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] PATH_INFO: `/v3/projects/d0eb9acf09814050abfbdb205cc5d8e0/users/f4afab72ee224e74b3f4078abbc4888a/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.276508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:21.277733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:21.288815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 900/1804] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:21.290258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.307715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae4611-3781-4e4b-8a40-4560db9edc12 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.313030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.313694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.313982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.314303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.315053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.317297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.328511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 901/1805] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:21.329458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.333619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:21.347048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0eb9acf09814050abfbdb205cc5d8e0, user_id=f4afab72ee224e74b3f4078abbc4888a, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.355747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.393343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 905/1806] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:21 2021] PUT /identity/v3/projects/d0eb9acf09814050abfbdb205cc5d8e0/users/f4afab72ee224e74b3f4078abbc4888a/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:21.393343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.474233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269640fa-e5f0-496a-bfe7-b58236147967 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.488008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b4fc-809f-4076-92fd-88a455077042 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.493645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab484-71af-4861-b091-8bee555b63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.494451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab484-71af-4861-b091-8bee555b63e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.494806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab484-71af-4861-b091-8bee555b63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.495411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab484-71af-4861-b091-8bee555b63e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.496251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fab484-71af-4861-b091-8bee555b63e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.505019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fab484-71af-4861-b091-8bee555b63e9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.521085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 906/1807] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:21 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:21.521085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.521085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.521085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.562175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] MFA Rules not processed for user `f4afab72ee224e74b3f4078abbc4888a`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:21.564273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:21.583839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.584699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.584982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.585260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.597740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.599718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.612257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 902/1808] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:21.615230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.626947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568a325-cb47-42e6-ba57-ae88de20a8ff service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.652908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f62e-7532-4f84-9c0a-8892fe796560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.653830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f62e-7532-4f84-9c0a-8892fe796560 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.654123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f62e-7532-4f84-9c0a-8892fe796560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.654561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f62e-7532-4f84-9c0a-8892fe796560 admin admin] PATH_INFO: `/v3/projects/bfea688a0a8d4d7fb18fb7945f4e5166/users/99808013953d4d36bdbb9706e679a13c/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.684481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 907/1809] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:21 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:21.686711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.700651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898886d-15c5-4098-8d6e-1bc9a845abdd None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.706369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.708271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.708659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.709081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.710594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.712143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:21.745781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 908/1810] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:21 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:21.750185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:21.937087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c155-2972-4cc0-bef7-e822508317b5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:21.957234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:21.958061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:21.958392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:21.958764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:21.959636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:21.961724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.001364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 909/1811] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:21 2021] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:22.002408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.015376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f62e-7532-4f84-9c0a-8892fe796560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfea688a0a8d4d7fb18fb7945f4e5166, user_id=99808013953d4d36bdbb9706e679a13c, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.019985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f62e-7532-4f84-9c0a-8892fe796560 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.021048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65546a3d-7348-42cb-b63e-0a6df47e15f6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.032073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.033522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.034885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.034999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.036314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.038043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.043484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 903/1812] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:21 2021] PUT /identity/v3/projects/bfea688a0a8d4d7fb18fb7945f4e5166/users/99808013953d4d36bdbb9706e679a13c/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:22.049293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 910/1813] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:22.055344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.055809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607368-dd7e-4db2-8689-de9626612787 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.064118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607368-dd7e-4db2-8689-de9626612787 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.064118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607368-dd7e-4db2-8689-de9626612787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.082850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efda95-1d8f-4594-82e0-880a85868218 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.126391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-39607368-dd7e-4db2-8689-de9626612787 None None] MFA Rules not processed for user `99808013953d4d36bdbb9706e679a13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:22.136827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-39607368-dd7e-4db2-8689-de9626612787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.229075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.230819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.231097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.231374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] PATH_INFO: `/v3/projects/36c10de23d5245aba55e8f1aaf2eb9f2/users/5d309212aa7f44cda222b65683bab47f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.257138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c10de23d5245aba55e8f1aaf2eb9f2, user_id=5d309212aa7f44cda222b65683bab47f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.259850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.273724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 911/1814] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:22 2021] PUT /identity/v3/projects/36c10de23d5245aba55e8f1aaf2eb9f2/users/5d309212aa7f44cda222b65683bab47f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:22.274816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.276371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.282063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 904/1815] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:22 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:22.282852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607368-dd7e-4db2-8689-de9626612787 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.295154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607368-dd7e-4db2-8689-de9626612787 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.356967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.357974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.358491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.358794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.359642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.360060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4fe53-6adb-468c-957b-7ddff9105963 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.361545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.365689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.366597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.366877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.367540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] PATH_INFO: `/v3/projects/586fa5260c6e46238035116c3568b194` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.368443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586fa5260c6e46238035116c3568b194)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.370392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.374137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 905/1816] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:22 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:22.375045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.376747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.492483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755254b-964c-4f7a-8c15-dfaa9aaa7553 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.496297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.496985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.502647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.502647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.564077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586fa5260c6e46238035116c3568b194', 'request_id': 'req-d5152795-43ee-478b-8fea-8693d7277c16'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.575098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.576539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586fa5260c6e46238035116c3568b194', 'request_id': 'req-d5152795-43ee-478b-8fea-8693d7277c16'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.576743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.586382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586fa5260c6e46238035116c3568b194', 'request_id': 'req-d5152795-43ee-478b-8fea-8693d7277c16'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.588182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 906/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:22 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:22.588874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.601472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fefe-5180-4aab-b24d-75035fd08073 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.614852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] The token cache is being invalidate because project 586fa5260c6e46238035116c3568b194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:22.615316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.616157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.618062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 912/1818] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:22 2021] DELETE /identity/v3/projects/586fa5260c6e46238035116c3568b194 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:22.622471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.625693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.664159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.665048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.665320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.665589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] PATH_INFO: `/v3/projects/36c10de23d5245aba55e8f1aaf2eb9f2/users/5d309212aa7f44cda222b65683bab47f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.667796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c10de23d5245aba55e8f1aaf2eb9f2, user_id=5d309212aa7f44cda222b65683bab47f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.670706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.684580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 907/1819] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:22 2021] PUT /identity/v3/projects/36c10de23d5245aba55e8f1aaf2eb9f2/users/5d309212aa7f44cda222b65683bab47f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:22.685479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.687577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.704328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5152795-43ee-478b-8fea-8693d7277c16 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.756610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5ee9-f79b-4bdd-b413-7085315bf567 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:22.761512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.762413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.762690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.762957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] PATH_INFO: `/v3/users/a2742c97abac48a8965a613e2e82782e` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.764349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2742c97abac48a8965a613e2e82782e)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.766335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.768550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:22.769498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.769855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.770230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] PATH_INFO: `/v3/users/99808013953d4d36bdbb9706e679a13c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.771835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99808013953d4d36bdbb9706e679a13c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:22.774175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:22.818005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2742c97abac48a8965a613e2e82782e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.825508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2742c97abac48a8965a613e2e82782e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.828915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99808013953d4d36bdbb9706e679a13c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.832900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2742c97abac48a8965a613e2e82782e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.836131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99808013953d4d36bdbb9706e679a13c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.843675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99808013953d4d36bdbb9706e679a13c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.844585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99808013953d4d36bdbb9706e679a13c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.846882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2742c97abac48a8965a613e2e82782e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.848261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d8cb0aa6-6f93-46db-98e7-7f7d6b0ce06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2742c97abac48a8965a613e2e82782e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.854422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 908/1820] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:22 2021] DELETE /identity/v3/users/a2742c97abac48a8965a613e2e82782e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:22.856063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.856504 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.856778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.864597 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ca36ad32-a7e9-44d6-a76e-3c7b2436d22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99808013953d4d36bdbb9706e679a13c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:22.874678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 913/1821] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:22 2021] DELETE /identity/v3/users/99808013953d4d36bdbb9706e679a13c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:22.879709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:22.880078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:22.880510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:22.886039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] MFA Rules not processed for user `5d309212aa7f44cda222b65683bab47f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:22.887208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.898803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:22.900092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.963673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 909/1822] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:22 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:22.974682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.976122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:22.984363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 914/1823] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:22.993227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:22.994763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:23.044103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaa4a8-c90d-47c7-b2f6-0a948689aa16 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.049534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:23.050376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.050706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.051500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.061573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:23.062902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:23.063145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea273f2e-4c2b-45df-9e2d-dcd33bf0d5b8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.066803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da846659-b2ba-4265-8024-0a8c990f2e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:23.067378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846659-b2ba-4265-8024-0a8c990f2e17 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.067654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846659-b2ba-4265-8024-0a8c990f2e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.067924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da846659-b2ba-4265-8024-0a8c990f2e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.076056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 910/1824] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:22 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:23.078040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da846659-b2ba-4265-8024-0a8c990f2e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:23.079572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da846659-b2ba-4265-8024-0a8c990f2e17 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:23.090192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 915/1825] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:23.170415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:23.172517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:23.190999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa80b9-a767-4278-af0e-50fa1634a3a6 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.205645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:23.207607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.208194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.208319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] PATH_INFO: `/v3/projects/2874736a9a844af8837a26e1ce21719b` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.211536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2874736a9a844af8837a26e1ce21719b)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:23.214211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:23.291102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2874736a9a844af8837a26e1ce21719b', 'request_id': 'req-f88f4701-38f0-4297-8948-14a09e31ce5c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:23.299704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2874736a9a844af8837a26e1ce21719b', 'request_id': 'req-f88f4701-38f0-4297-8948-14a09e31ce5c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:23.313497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2874736a9a844af8837a26e1ce21719b', 'request_id': 'req-f88f4701-38f0-4297-8948-14a09e31ce5c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:23.326031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] The token cache is being invalidate because project 2874736a9a844af8837a26e1ce21719b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:23.326378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:23.326981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f88f4701-38f0-4297-8948-14a09e31ce5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:23.329231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 911/1826] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:23 2021] DELETE /identity/v3/projects/2874736a9a844af8837a26e1ce21719b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:23.338466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.338873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.339887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.387768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:23.389440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:23.509139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 916/1827] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:23.509819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.510378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.510733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.546014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:23.547299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:23.566723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 912/1828] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:23.571557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:23.596173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b030ea0-8fa4-4208-81b6-87b2773422ea None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.611092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:23.612468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.614131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.614568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.616714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:23.617124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:23.623568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:23.644220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:23.652753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 917/1829] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:23.658316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982662c-d831-43a6-8d2f-69ce83f8615c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.672649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:23.673828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.674327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.674693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.675492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:23.678123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:23.739400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 913/1830] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:23 2021] POST /identity/v3/projects => generated 399 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:23.741997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:23.754326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00539-1147-4165-9927-51d0ef07b9e1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.816123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:23.818817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:23.909495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:23.911409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:23.911861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:23.912280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:23.913162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:23.915260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:23.970757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767a87a-732c-48b8-82f4-b30dadd1de86 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:23.996277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.005542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.005542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.005542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] PATH_INFO: `/v3/projects/bfea688a0a8d4d7fb18fb7945f4e5166` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.005852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 918/1831] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:23 2021] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:24.008284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfea688a0a8d4d7fb18fb7945f4e5166)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.010292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.013565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.056488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df1213-795b-4247-bf73-a66527cb5fcb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:24.078913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.081949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.083835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.084202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.085266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.089770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.120927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 919/1832] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:24.122098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.147829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfea688a0a8d4d7fb18fb7945f4e5166', 'request_id': 'req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:24.154548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1759993-97e5-4c88-a27f-c3e339e5f95e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:24.165446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfea688a0a8d4d7fb18fb7945f4e5166', 'request_id': 'req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:24.181953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfea688a0a8d4d7fb18fb7945f4e5166', 'request_id': 'req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:24.214451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] The token cache is being invalidate because project bfea688a0a8d4d7fb18fb7945f4e5166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:24.215086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:24.215963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-4f5b220b-fc33-4bcd-a35c-d43b2d9e6335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:24.218007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 914/1833] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:23 2021] DELETE /identity/v3/projects/bfea688a0a8d4d7fb18fb7945f4e5166 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:24.224385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb250a99-be78-43a7-83f3-37ed320c7dcf None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.224854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb250a99-be78-43a7-83f3-37ed320c7dcf None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.225297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb250a99-be78-43a7-83f3-37ed320c7dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.261191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-bb250a99-be78-43a7-83f3-37ed320c7dcf None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:24.263201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-bb250a99-be78-43a7-83f3-37ed320c7dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:24.303054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.303745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.304031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.304304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.305059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.306805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.335731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 920/1834] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:24 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:24.336922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.339031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:24.380505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700c0c9-4c5c-491a-a0cd-60148667f3af admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:24.393924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f046225-39d0-4e3f-bd02-8d46bee1c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.395006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046225-39d0-4e3f-bd02-8d46bee1c975 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.395285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046225-39d0-4e3f-bd02-8d46bee1c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.395560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046225-39d0-4e3f-bd02-8d46bee1c975 admin admin] PATH_INFO: `/v3/projects/c13f6265558d4d439c12daec8011eedc/users/82db8a04857149c982e676cfebbd62b6/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.413044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 915/1835] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:24.414958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.415131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.415355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.433021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f046225-39d0-4e3f-bd02-8d46bee1c975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13f6265558d4d439c12daec8011eedc, user_id=82db8a04857149c982e676cfebbd62b6, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.436296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f046225-39d0-4e3f-bd02-8d46bee1c975 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.461420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:24.462693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:24.474370 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 921/1836] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:24 2021] PUT /identity/v3/projects/c13f6265558d4d439c12daec8011eedc/users/82db8a04857149c982e676cfebbd62b6/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:24.479366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.479745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.480297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.549685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] MFA Rules not processed for user `82db8a04857149c982e676cfebbd62b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:24.554492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:24.660852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 916/1837] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:24.663672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.679153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2329e-5514-4d30-9fae-474accd1b826 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:24.695669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.696577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.698656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.699047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.699974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:24.702179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.704890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.713611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 922/1838] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:24.719749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.757880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 917/1839] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:24.760802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2297ad1-b439-4c85-884b-e72a53e8d920 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:24.765303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.778834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.781294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.784478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.785552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.788779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.794571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc99f-d821-4878-91f7-a45f53ffc7ec admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:24.796291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.820437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:24.821173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:24.821578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:24.821964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:24.822823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:24.831652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:24.879274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 923/1840] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:24.882415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:24.926419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 918/1841] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:24.929007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.045591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd34dc-c992-429d-9f11-f45a2ecf3c24 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.060400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.061010 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad452-f5fe-4418-8d64-4c3c650cadcd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.061435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.061942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.062394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.063249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.065612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.067336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.068123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.068517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.068958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.069819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.072596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.111873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 919/1842] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:25.115837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.117513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 924/1843] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:24 2021] POST /identity/v3/users => generated 307 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:25.121789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.131706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf0c9b-bf84-43cd-8389-4a07cf270d1b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.138863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.140080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6def8-0766-470c-aded-8e3391c7a2a6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.140469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.140868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.141254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.142332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.145115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.146451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.147548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.148117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.148445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.149339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.151108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.163203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 925/1844] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:25.164485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 920/1845] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:25.164833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.168742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.178330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba003-aa0c-4293-af82-d14f14384134 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.187368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.189309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.190585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.191205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.192233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.194323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.208702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478591a4-ff6b-44eb-b014-bb38707e527d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.221733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 926/1846] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:25.226450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.228045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.229649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.231828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.232345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] PATH_INFO: `/v3/projects/aab60ae6196a4f65ac5ebd1ee549a38a/users/3d778bb1f64f46368e57c2d22f05cc1e/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.246228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904386-b628-47a2-92a7-2b42078750c0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.253237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106b5f-1df5-4ced-91fe-49e639443441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.254704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106b5f-1df5-4ced-91fe-49e639443441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.255237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106b5f-1df5-4ced-91fe-49e639443441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.255521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106b5f-1df5-4ced-91fe-49e639443441 admin admin] PATH_INFO: `/v3/projects/e1bdcb239aac4119b458cd15cda7b067/users/a8ed72cf0de4433999dc0c82dd2d4251/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.271624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab60ae6196a4f65ac5ebd1ee549a38a, user_id=3d778bb1f64f46368e57c2d22f05cc1e, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.276742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106b5f-1df5-4ced-91fe-49e639443441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bdcb239aac4119b458cd15cda7b067, user_id=a8ed72cf0de4433999dc0c82dd2d4251, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.276859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.281046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106b5f-1df5-4ced-91fe-49e639443441 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.294246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 921/1847] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:25 2021] PUT /identity/v3/projects/aab60ae6196a4f65ac5ebd1ee549a38a/users/3d778bb1f64f46368e57c2d22f05cc1e/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:25.298671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.313583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 927/1848] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:25 2021] PUT /identity/v3/projects/e1bdcb239aac4119b458cd15cda7b067/users/a8ed72cf0de4433999dc0c82dd2d4251/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:25.323767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.324262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.324688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.357837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] MFA Rules not processed for user `a8ed72cf0de4433999dc0c82dd2d4251`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:25.359196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:25.380277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf5b59-957e-47a0-97a3-f9f944f5761f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.435701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 928/1849] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:25 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:25.437104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.438229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:25.454086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.455144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.455537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.455885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.457712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.460476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.476544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 922/1850] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:25 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:25.477554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.484996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:25.532359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f73db-10c1-4274-9907-bc553892a467 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.540909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.543144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.544405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.544405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] PATH_INFO: `/v3/users/f4afab72ee224e74b3f4078abbc4888a` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.559366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4afab72ee224e74b3f4078abbc4888a)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.564973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.587761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8aa805-0385-4ea2-b584-4e89c89804ef admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.596496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.597488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.597793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.598072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.616869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.618761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.634456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 923/1851] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:25 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:25.649396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.657930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4afab72ee224e74b3f4078abbc4888a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:25.670534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4afab72ee224e74b3f4078abbc4888a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:25.677612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fe2e5-d30c-4cbd-babd-3eb6f8b0d4cf service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:25.682733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4afab72ee224e74b3f4078abbc4888a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:25.683746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4afab72ee224e74b3f4078abbc4888a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:25.694859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547d6b6-b8dd-419c-b569-4a193f8c3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:25.695981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d6b6-b8dd-419c-b569-4a193f8c3895 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.696404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d6b6-b8dd-419c-b569-4a193f8c3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.696850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547d6b6-b8dd-419c-b569-4a193f8c3895 admin admin] PATH_INFO: `/v3/projects/aab60ae6196a4f65ac5ebd1ee549a38a/users/3d778bb1f64f46368e57c2d22f05cc1e/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.699894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547d6b6-b8dd-419c-b569-4a193f8c3895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab60ae6196a4f65ac5ebd1ee549a38a, user_id=3d778bb1f64f46368e57c2d22f05cc1e, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:25.705934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547d6b6-b8dd-419c-b569-4a193f8c3895 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:25.708945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-00fc591e-a123-47fb-9f95-0c98f26b25bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4afab72ee224e74b3f4078abbc4888a'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:25.729828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 929/1852] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:25 2021] DELETE /identity/v3/users/f4afab72ee224e74b3f4078abbc4888a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:25.738739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 924/1853] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:25 2021] PUT /identity/v3/projects/aab60ae6196a4f65ac5ebd1ee549a38a/users/3d778bb1f64f46368e57c2d22f05cc1e/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:25.738947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.738947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.738947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.745115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:25.745683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:25.746176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:25.776843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:25.779511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:25.805562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] MFA Rules not processed for user `3d778bb1f64f46368e57c2d22f05cc1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:25.809467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:25.896407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 930/1854] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:25.916308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:25.917875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:26.016000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744fc98-a1e3-4015-b5a6-d87cdf8596a2 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:26.020116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 925/1855] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:25 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:26.025509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:26.026530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:26.027122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:26.027748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:26.029792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:26.032932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:26.048053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:26.050055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:26.085367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 931/1856] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:26.141802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c46f0-cafd-4ecc-8449-a34bacf18f2a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:26.166542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:26.167770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:26.169415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:26.169766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:26.207285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:26.208783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:26.229806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 926/1857] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:26 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:26.352914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:26.355380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:26.380852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f42f9-9722-48ea-87c0-a1edd26b28b3 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:26.392022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:26.393132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:26.393524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:26.393673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:26.398329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:26.492203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:26.493920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:26.504516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 932/1858] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:26 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:26.854516 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:26.856089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:26.875549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88adf3-0ddf-4b0f-ae64-e29307d19a12 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:26.892587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:26.893580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:26.893923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:26.894900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] PATH_INFO: `/v3/projects/d0eb9acf09814050abfbdb205cc5d8e0` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:26.896262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0eb9acf09814050abfbdb205cc5d8e0)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:26.898745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:26.962720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0eb9acf09814050abfbdb205cc5d8e0', 'request_id': 'req-39a9f975-3676-40bd-83c1-bc9608e63944'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:26.970525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0eb9acf09814050abfbdb205cc5d8e0', 'request_id': 'req-39a9f975-3676-40bd-83c1-bc9608e63944'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:26.980949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0eb9acf09814050abfbdb205cc5d8e0', 'request_id': 'req-39a9f975-3676-40bd-83c1-bc9608e63944'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:26.993654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] The token cache is being invalidate because project d0eb9acf09814050abfbdb205cc5d8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:26.994041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:26.995248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:26.997268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 927/1859] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:26 2021] DELETE /identity/v3/projects/d0eb9acf09814050abfbdb205cc5d8e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:27.001302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:27.012360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8b0fd-cd80-46d0-829d-9a3d98b777bb service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:27.074313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:27.075197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.075474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.075782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] PATH_INFO: `/v3/users/5d309212aa7f44cda222b65683bab47f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.077044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d309212aa7f44cda222b65683bab47f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:27.079193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:27.130624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d309212aa7f44cda222b65683bab47f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.141371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d309212aa7f44cda222b65683bab47f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.150738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d309212aa7f44cda222b65683bab47f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.151452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d309212aa7f44cda222b65683bab47f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.166260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b0240e5e-e81b-4c96-b793-0edb1d115725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d309212aa7f44cda222b65683bab47f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.172547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 933/1860] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:27 2021] DELETE /identity/v3/users/5d309212aa7f44cda222b65683bab47f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:27.469129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:27.470603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:27.495435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9f975-3676-40bd-83c1-bc9608e63944 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:27.552618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:27.553468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.553752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.554025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] PATH_INFO: `/v3/projects/36c10de23d5245aba55e8f1aaf2eb9f2` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.555448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c10de23d5245aba55e8f1aaf2eb9f2)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:27.558805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:27.610328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c10de23d5245aba55e8f1aaf2eb9f2', 'request_id': 'req-25e35a74-ccba-435b-933a-35f93cc3b5f1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.617804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c10de23d5245aba55e8f1aaf2eb9f2', 'request_id': 'req-25e35a74-ccba-435b-933a-35f93cc3b5f1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.626794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c10de23d5245aba55e8f1aaf2eb9f2', 'request_id': 'req-25e35a74-ccba-435b-933a-35f93cc3b5f1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.645546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] The token cache is being invalidate because project 36c10de23d5245aba55e8f1aaf2eb9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:27.645782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.647451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-25e35a74-ccba-435b-933a-35f93cc3b5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:27.649385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 928/1861] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:27 2021] DELETE /identity/v3/projects/36c10de23d5245aba55e8f1aaf2eb9f2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:27.655471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.655765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.656043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.674261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:27.676184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:27.733735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 934/1862] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:27.741849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.742132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.742436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.760556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:27.761747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:27.770216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 929/1863] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:27.774738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:27.784063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3baad-0f59-4b8e-a645-e74d9e0030f5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:27.789091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:27.789731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.790009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.790314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.791042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:27.791343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:27.792903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:27.804147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 935/1864] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:27.808756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:27.819163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb7a0f-da58-4126-bf3c-a4898a0103a9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:27.823430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:27.824084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.824364 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.824636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.825355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:27.827309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:27.853047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 930/1865] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:27 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:27.857179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:27.867263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd5531-7b10-4919-baee-7ccbc31780a1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:27.935130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:27.935916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.936202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.936478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.937201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:27.939218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:27.963172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 936/1866] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:27 2021] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:27.964430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:27.975298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23c90e-a252-42b4-97f1-a922a59f2305 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:27.979809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:27.980454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:27.980729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:27.980997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:27.981719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:27.983408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:27.994414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 931/1867] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:27.998267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.008171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad370d-a3c0-4d78-8a6c-737954d481a3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.013540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947f5b8-4c50-4f58-bffb-4e9d51e942d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.014247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f5b8-4c50-4f58-bffb-4e9d51e942d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.014516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f5b8-4c50-4f58-bffb-4e9d51e942d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.014799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947f5b8-4c50-4f58-bffb-4e9d51e942d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.015543 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f5b8-4c50-4f58-bffb-4e9d51e942d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.017149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947f5b8-4c50-4f58-bffb-4e9d51e942d8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.027869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 937/1868] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:28.031833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.042115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b21644-dfff-4638-ab00-162ae555660e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.046709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.047674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.047923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.048208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] PATH_INFO: `/v3/projects/da44cc1ee4cd4bbb9330b30af53d15bb/users/7f8f6f36e94f4f7e98326cc43f39bee6/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.064443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da44cc1ee4cd4bbb9330b30af53d15bb, user_id=7f8f6f36e94f4f7e98326cc43f39bee6, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.067192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.080525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 932/1869] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:28 2021] PUT /identity/v3/projects/da44cc1ee4cd4bbb9330b30af53d15bb/users/7f8f6f36e94f4f7e98326cc43f39bee6/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:28.090743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.091199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.091328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.117720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] MFA Rules not processed for user `7f8f6f36e94f4f7e98326cc43f39bee6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:28.118956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:28.194679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 938/1870] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:28 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:28.197065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.271179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16ed2a-ec05-4229-ac8d-d734ffa9df7f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.276982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.277751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.278099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.278472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.279513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.281624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.315443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 933/1871] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:28 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:28.317398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.328427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca21194-0d7c-4915-b9e7-7070325d88ed None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.399560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.400385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.400769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.401146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.404645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.407307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.442546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 939/1872] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:28 2021] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:28.446186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.460872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4d601-b70d-4525-908a-161bd494b5ec admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.467226 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.468377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.469440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.469984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.471760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.474465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.496163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 934/1873] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:28.500022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.511430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344166d-6586-4de8-9eab-b9e5367d5697 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.518190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.519641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.519927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.520201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] PATH_INFO: `/v3/projects/46fb4ae26d2940b6877d17f129165b39/users/a7b3684fa67f42fe8d226b144c0cc079/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.547958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fb4ae26d2940b6877d17f129165b39, user_id=a7b3684fa67f42fe8d226b144c0cc079, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.552360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.573505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 940/1874] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:28 2021] PUT /identity/v3/projects/46fb4ae26d2940b6877d17f129165b39/users/a7b3684fa67f42fe8d226b144c0cc079/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:28.574759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.589826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fa94b-3fc6-4c91-b207-ef9708c9f598 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.724614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dd31d-9389-4eb9-9a54-291d7ef7567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.725334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd31d-9389-4eb9-9a54-291d7ef7567e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.725612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd31d-9389-4eb9-9a54-291d7ef7567e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.725876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dd31d-9389-4eb9-9a54-291d7ef7567e admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.726647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd31d-9389-4eb9-9a54-291d7ef7567e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.729991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1dd31d-9389-4eb9-9a54-291d7ef7567e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.746214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 935/1875] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:28 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:28.749242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:28.765762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccb642-33c8-43d2-a2c8-9aa1051c9254 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:28.774973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:28.776233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.776723 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.777566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] PATH_INFO: `/v3/projects/46fb4ae26d2940b6877d17f129165b39/users/a7b3684fa67f42fe8d226b144c0cc079/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.780560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fb4ae26d2940b6877d17f129165b39, user_id=a7b3684fa67f42fe8d226b144c0cc079, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:28.785497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:28.820478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 941/1876] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:28 2021] PUT /identity/v3/projects/46fb4ae26d2940b6877d17f129165b39/users/a7b3684fa67f42fe8d226b144c0cc079/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:28.833098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b036d1-341b-4b30-bbe1-fd175be02f95 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:28.833380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b036d1-341b-4b30-bbe1-fd175be02f95 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:28.833962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b036d1-341b-4b30-bbe1-fd175be02f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:28.869257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-99b036d1-341b-4b30-bbe1-fd175be02f95 None None] MFA Rules not processed for user `a7b3684fa67f42fe8d226b144c0cc079`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:28.870503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-99b036d1-341b-4b30-bbe1-fd175be02f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:28.975164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 936/1877] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:28 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:29.004225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:29.006344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:29.076535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c590f6d-809b-48fd-8b90-2c12362a917d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:29.080718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af355b-2820-4a61-a94c-0b934ec2dea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:29.082000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af355b-2820-4a61-a94c-0b934ec2dea2 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:29.082535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af355b-2820-4a61-a94c-0b934ec2dea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:29.082817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af355b-2820-4a61-a94c-0b934ec2dea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:29.144965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af355b-2820-4a61-a94c-0b934ec2dea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:29.146337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af355b-2820-4a61-a94c-0b934ec2dea2 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:29.157194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 942/1878] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:29 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:33.048002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404c8c-55ac-4730-bc22-6371bc0d31bf None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:33.048819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404c8c-55ac-4730-bc22-6371bc0d31bf None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:33.048819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5404c8c-55ac-4730-bc22-6371bc0d31bf None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:33.050536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 937/1879] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 13:04:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:04:33.059214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:33.060154 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:33.060765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:33.089263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:33.090757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:33.165703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 943/1880] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 13:04:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:33.180328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5404c8c-55ac-4730-bc22-6371bc0d31bf None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:33.182436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f5404c8c-55ac-4730-bc22-6371bc0d31bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:33.201704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5404c8c-55ac-4730-bc22-6371bc0d31bf None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:33.208926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683df97-b177-4ff9-bff3-fb6e1fd7c053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:33.209655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683df97-b177-4ff9-bff3-fb6e1fd7c053 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:33.210002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683df97-b177-4ff9-bff3-fb6e1fd7c053 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:33.210394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683df97-b177-4ff9-bff3-fb6e1fd7c053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:33.219890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683df97-b177-4ff9-bff3-fb6e1fd7c053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:33.221642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683df97-b177-4ff9-bff3-fb6e1fd7c053 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:33.232428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 938/1881] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:38.277820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:38.279486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:38.341824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad9a47-f3ac-4a8b-aa3b-0043cd0150f7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:38.346383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:38.347862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:38.348140 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:38.348411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] PATH_INFO: `/v3/users/82db8a04857149c982e676cfebbd62b6` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:38.349625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82db8a04857149c982e676cfebbd62b6)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:38.351682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:38.395809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82db8a04857149c982e676cfebbd62b6'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:38.403178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82db8a04857149c982e676cfebbd62b6'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:38.410583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82db8a04857149c982e676cfebbd62b6'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:38.411214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82db8a04857149c982e676cfebbd62b6'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:38.422450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82db8a04857149c982e676cfebbd62b6'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:38.428216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 944/1882] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:38 2021] DELETE /identity/v3/users/82db8a04857149c982e676cfebbd62b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:38.433096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:38.433564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:38.433665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:38.451405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:38.452604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:38.510122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 939/1883] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:38.520721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:38.522415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:38.576149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195ea94-033f-40be-857f-0ee2eda86b1a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:38.579829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:38.580468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:38.580744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:38.581631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:38.590635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:38.592052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:38.603441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 945/1884] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:38.872135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:38.875149 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:38.950538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0249bc6-b029-4ab4-86c8-854a14add7cc None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:38.987499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:38.989036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:38.989482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:38.998529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] PATH_INFO: `/v3/users/a8ed72cf0de4433999dc0c82dd2d4251` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:39.000022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ed72cf0de4433999dc0c82dd2d4251)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:39.007978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:39.009822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:39.012719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:39.187191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ed72cf0de4433999dc0c82dd2d4251'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.196854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb2197-0335-43d2-8348-b17e77dae2ca service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:39.203548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:39.204145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ed72cf0de4433999dc0c82dd2d4251'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.215054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ed72cf0de4433999dc0c82dd2d4251'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.216884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:39.217554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:39.218043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:39.233593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ed72cf0de4433999dc0c82dd2d4251'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.234433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ed72cf0de4433999dc0c82dd2d4251'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.236029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:39.241364 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 940/1885] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:38 2021] DELETE /identity/v3/users/a8ed72cf0de4433999dc0c82dd2d4251 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:39.245123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:39.247215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:39.323632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af9105-8f55-4ce9-acb1-ac6d6dc60d39 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:39.329269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:39.330510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:39.331015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:39.331982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] PATH_INFO: `/v3/projects/c13f6265558d4d439c12daec8011eedc` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:39.333414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13f6265558d4d439c12daec8011eedc)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:39.335848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:39.355012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:39.356999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b27962-f3c0-403b-8d8a-9fec47ef351f service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:39.396408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 946/1886] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:39 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:39.398646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:39.399150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:39.402118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:39.403109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13f6265558d4d439c12daec8011eedc', 'request_id': 'req-70e4b1e1-2972-4c8d-bdc3-3223745118a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.410208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13f6265558d4d439c12daec8011eedc', 'request_id': 'req-70e4b1e1-2972-4c8d-bdc3-3223745118a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.426183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13f6265558d4d439c12daec8011eedc', 'request_id': 'req-70e4b1e1-2972-4c8d-bdc3-3223745118a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.446062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] The token cache is being invalidate because project c13f6265558d4d439c12daec8011eedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:39.446704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.447391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.449973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 941/1887] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:39 2021] DELETE /identity/v3/projects/c13f6265558d4d439c12daec8011eedc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:39.453993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:39.460619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:39.462776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:39.463468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:39.595502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 947/1888] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:39.603030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:39.604425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:39.606278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4b1e1-2972-4c8d-bdc3-3223745118a1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:39.611697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:39.613455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:39.613952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:39.614255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] PATH_INFO: `/v3/users/3d778bb1f64f46368e57c2d22f05cc1e` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:39.615555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d778bb1f64f46368e57c2d22f05cc1e)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:39.618201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:39.682446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f993430-a993-40c2-a7d7-48b3e8303eb5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:39.687300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d778bb1f64f46368e57c2d22f05cc1e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.694739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:39.695875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:39.696399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:39.696947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:39.697050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d778bb1f64f46368e57c2d22f05cc1e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.709530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:39.709992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d778bb1f64f46368e57c2d22f05cc1e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.711904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:39.727156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d778bb1f64f46368e57c2d22f05cc1e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.727639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 948/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:39.728063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d778bb1f64f46368e57c2d22f05cc1e'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:39.735657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 942/1890] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:39 2021] DELETE /identity/v3/users/3d778bb1f64f46368e57c2d22f05cc1e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:40.088413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.090212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.108558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a5cc-64b2-44e3-b14c-84dbeb98a11a service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.183692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.187067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.191126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.192206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.192586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.192963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] PATH_INFO: `/v3/projects/e1bdcb239aac4119b458cd15cda7b067` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.194722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bdcb239aac4119b458cd15cda7b067)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.197213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.219555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3b3e0-f52c-46ca-8101-5b4bb17ce266 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.226354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.227278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.227557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.227826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] PATH_INFO: `/v3/projects/aab60ae6196a4f65ac5ebd1ee549a38a` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.229199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab60ae6196a4f65ac5ebd1ee549a38a)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.231968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.254718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bdcb239aac4119b458cd15cda7b067', 'request_id': 'req-c0aa039b-d691-44ab-a2e0-1e018680e9bd'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.261914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bdcb239aac4119b458cd15cda7b067', 'request_id': 'req-c0aa039b-d691-44ab-a2e0-1e018680e9bd'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.271356 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bdcb239aac4119b458cd15cda7b067', 'request_id': 'req-c0aa039b-d691-44ab-a2e0-1e018680e9bd'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.282536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] The token cache is being invalidate because project e1bdcb239aac4119b458cd15cda7b067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:40.282823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.283635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c0aa039b-d691-44ab-a2e0-1e018680e9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.286128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 949/1891] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:40 2021] DELETE /identity/v3/projects/e1bdcb239aac4119b458cd15cda7b067 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:40.291710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76907a-11f6-4e2d-815f-0b733db52703 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.291997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76907a-11f6-4e2d-815f-0b733db52703 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.292275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76907a-11f6-4e2d-815f-0b733db52703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.294053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab60ae6196a4f65ac5ebd1ee549a38a', 'request_id': 'req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.301341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab60ae6196a4f65ac5ebd1ee549a38a', 'request_id': 'req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.310343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab60ae6196a4f65ac5ebd1ee549a38a', 'request_id': 'req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.313787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2b76907a-11f6-4e2d-815f-0b733db52703 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:40.315038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2b76907a-11f6-4e2d-815f-0b733db52703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.323370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] The token cache is being invalidate because project aab60ae6196a4f65ac5ebd1ee549a38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:40.323651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.324371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-5195760a-bb4a-41fa-8ec6-9f78ad2c396c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:40.326536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 943/1892] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:40 2021] DELETE /identity/v3/projects/aab60ae6196a4f65ac5ebd1ee549a38a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:40.333382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69068-586f-4e3b-8298-0ed978283ca4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.333738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69068-586f-4e3b-8298-0ed978283ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.334078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69068-586f-4e3b-8298-0ed978283ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.354016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-27f69068-586f-4e3b-8298-0ed978283ca4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:40.355337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-27f69068-586f-4e3b-8298-0ed978283ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.388204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 950/1893] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:40.397842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.398359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.398692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.417194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 944/1894] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:40.421878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:40.423164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.426336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.426636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.426895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.432436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 951/1895] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:40.436739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.446734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b986f2-c0cb-4358-90fc-715b1c7c8d5e None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.447652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:40.448898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.452765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.453898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.454436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.454881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.456542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:40.457028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.458561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 945/1896] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:40.462106 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.462996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.475379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080f7cd-64cc-480d-9545-7753ed764b20 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.477220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 952/1897] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:04:40.481209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.481615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.482223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.482804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.483085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.483835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:40.484136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.486036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.494842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e01fa-1547-4cb9-ab97-6c2d63e95842 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.504259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.504986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.505269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.505541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.506321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.508236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.514458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 946/1898] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:40.521210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.536259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a3a0-159c-4cba-b9e7-510317d08511 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.549252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 953/1899] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:40.549468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.553843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.555421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.555986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.557494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.558424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.561312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.597365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 947/1900] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:40.598934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.667619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc112d-261f-4f67-a2a6-cbd9116a7f69 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.728003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5f99f-8876-4ff8-a48e-d170b0c1c8e0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.742711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.743388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.743664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.743928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.744657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.746675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.756460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.758509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.758802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.759083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.759943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.762139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.776511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 948/1901] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:40.781325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.790614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 954/1902] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:40.791612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.798877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65d1d-6ebd-40cd-b86b-e6a4a2d61650 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.803670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde8bdc-83fe-46cb-b09b-35b310f64ebe admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.811580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.812272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.812537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.812810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.813582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.815480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.817812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.818603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.818949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.819286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.820161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.821867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.830058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 949/1903] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:40 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:40.831394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.835446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 955/1904] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:40 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:40.839040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.847406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d51693-56db-47f7-a4a7-e14dbe65be65 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.849625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa8e2f-f615-4b53-bf69-256b7d763791 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.852276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.853133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.853618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.853966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.854752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.854961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.855401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.855714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.856257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.857081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.857208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.858796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.870198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 950/1905] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:40.870557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 956/1906] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:40.874610 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.874727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:40.886435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6fac6-7e8e-4de3-9294-8590aa9b6d41 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.886744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae7900-75b2-4683-833a-d3c6e920e8f7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:40.893623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e4fea-3d1d-4bf6-b970-1e14e1a01dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.894069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded7931-f53c-4a5f-ab9d-381acf66f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:40.894724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4fea-3d1d-4bf6-b970-1e14e1a01dab admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.895010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4fea-3d1d-4bf6-b970-1e14e1a01dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.895222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded7931-f53c-4a5f-ab9d-381acf66f5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.895324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e4fea-3d1d-4bf6-b970-1e14e1a01dab admin admin] PATH_INFO: `/v3/projects/befd8eb6614b4ac8843054c98256f28c/users/d51f4860ab434bac8cb1a2f1d551123f/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.895622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded7931-f53c-4a5f-ab9d-381acf66f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.895961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded7931-f53c-4a5f-ab9d-381acf66f5fa admin admin] PATH_INFO: `/v3/projects/f52e4e9c188f486bb5f1ba602f04a443/users/9c01692780044d67b951baa49f07af79/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.915706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e4fea-3d1d-4bf6-b970-1e14e1a01dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=befd8eb6614b4ac8843054c98256f28c, user_id=d51f4860ab434bac8cb1a2f1d551123f, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.917685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded7931-f53c-4a5f-ab9d-381acf66f5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52e4e9c188f486bb5f1ba602f04a443, user_id=9c01692780044d67b951baa49f07af79, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:40.918815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e4fea-3d1d-4bf6-b970-1e14e1a01dab admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.921050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded7931-f53c-4a5f-ab9d-381acf66f5fa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:40.944071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 957/1907] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:40 2021] PUT /identity/v3/projects/befd8eb6614b4ac8843054c98256f28c/users/d51f4860ab434bac8cb1a2f1d551123f/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:40.944203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 951/1908] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:40 2021] PUT /identity/v3/projects/f52e4e9c188f486bb5f1ba602f04a443/users/9c01692780044d67b951baa49f07af79/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:40.950179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.950179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.950462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.955388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:40.955735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:40.955988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:40.983120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] MFA Rules not processed for user `9c01692780044d67b951baa49f07af79`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:40.984504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:40.984681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] MFA Rules not processed for user `d51f4860ab434bac8cb1a2f1d551123f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:40.985943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:41.076124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 958/1909] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:41.080382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 952/1910] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:41.080505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.090777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.092152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:41.143740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002137-0127-4123-a0bf-62824af65a38 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.147709 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cc075-f9bd-4766-895d-d6d579f17c40 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.148912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.149710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.150088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.150496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.151202 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.151490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.152132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.152413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.152684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.153101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.162200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.163932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.175211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 953/1911] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:41 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:41.180852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 959/1912] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:41 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:41.185954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.197350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb560653-b2d8-4e9e-914a-775f134f9ac5 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.260757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.261695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.261898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.262252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.262914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.265326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.288525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 954/1913] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:41 2021] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:41.289822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.300807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3332851-76f5-4d25-bb52-ff2030871b4f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.305318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.305974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.306294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.306567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.307298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.309096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.320320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 960/1914] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:41.324592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.335511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c18cf4-a1c4-406a-bf3d-9c9c84971447 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.340788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.341785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.342175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.342474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] PATH_INFO: `/v3/projects/4834372aec7f44a4841514204fd5e4e5/users/25895d8e541646a9aa730b1b9304a0a1/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.360242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4834372aec7f44a4841514204fd5e4e5, user_id=25895d8e541646a9aa730b1b9304a0a1, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.363470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.377360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 955/1915] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:41 2021] PUT /identity/v3/projects/4834372aec7f44a4841514204fd5e4e5/users/25895d8e541646a9aa730b1b9304a0a1/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:41.381923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.392193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399249a6-ef52-4348-8e41-2caea1ed2f67 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.450520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e81f6-e86a-481e-8465-473d90dac29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.451190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e81f6-e86a-481e-8465-473d90dac29d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.451473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e81f6-e86a-481e-8465-473d90dac29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.451750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e81f6-e86a-481e-8465-473d90dac29d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.452502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e81f6-e86a-481e-8465-473d90dac29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.454445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e81f6-e86a-481e-8465-473d90dac29d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.466177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 961/1916] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:41 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:41.469755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.489410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0106a-bdbb-4236-8e29-cbfd7735e5ac admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.494199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.495212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.495490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.495759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] PATH_INFO: `/v3/projects/4834372aec7f44a4841514204fd5e4e5/users/25895d8e541646a9aa730b1b9304a0a1/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.497904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4834372aec7f44a4841514204fd5e4e5, user_id=25895d8e541646a9aa730b1b9304a0a1, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.500713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.511192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 956/1917] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:41 2021] PUT /identity/v3/projects/4834372aec7f44a4841514204fd5e4e5/users/25895d8e541646a9aa730b1b9304a0a1/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:41.521256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.521798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.522075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.547769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] MFA Rules not processed for user `25895d8e541646a9aa730b1b9304a0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:41.548732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:41.615594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 962/1918] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:41 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:41.625079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.626794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:41.680907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5770-73de-4ea8-8637-ce66aae3fba1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.684459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.685090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.685384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.685634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.694445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.695847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.705127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 957/1919] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:41 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:41.795254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:41.809215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27b3d3-e3ac-4b97-b8dd-49e9ea4822e5 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:41.814448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed437c-7a6c-45ac-aff4-310b0af82076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:41.815221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed437c-7a6c-45ac-aff4-310b0af82076 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:41.815503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed437c-7a6c-45ac-aff4-310b0af82076 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:41.815809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed437c-7a6c-45ac-aff4-310b0af82076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:41.872309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed437c-7a6c-45ac-aff4-310b0af82076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:41.873732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed437c-7a6c-45ac-aff4-310b0af82076 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:41.882789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 963/1920] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:41 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:45.584234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:45.667162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4db17-6fad-46db-9830-6b9194f6d6e6 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:45.676271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:45.677630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:45.677981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:45.678253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] PATH_INFO: `/v3/users/9c01692780044d67b951baa49f07af79` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:45.679827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c01692780044d67b951baa49f07af79)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:45.682099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:45.747404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c01692780044d67b951baa49f07af79'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:45.767043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c01692780044d67b951baa49f07af79'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:45.778133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c01692780044d67b951baa49f07af79'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:45.793763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c01692780044d67b951baa49f07af79'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:45.794703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c01692780044d67b951baa49f07af79'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:45.801478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 958/1921] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:45 2021] DELETE /identity/v3/users/9c01692780044d67b951baa49f07af79 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:45.806404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:45.808178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:45.808534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:45.827600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:45.829043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:45.891181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 964/1922] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:45.901854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:45.903416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:45.963483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d6bf3-f10d-49a1-ab0f-6f78f9e2a773 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:45.967133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:45.967774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:45.968053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:45.968326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:45.977585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:45.979072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:45.989863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 959/1923] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:46.251353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:46.253348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:46.270796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0b4f-0cd0-4be1-88bd-7eec7b0fc954 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:46.276105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:46.276984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:46.278491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:46.279642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] PATH_INFO: `/v3/projects/f52e4e9c188f486bb5f1ba602f04a443` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:46.281192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52e4e9c188f486bb5f1ba602f04a443)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:46.283203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:46.337461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52e4e9c188f486bb5f1ba602f04a443', 'request_id': 'req-330373a4-bb24-4201-9784-3d47319b6035'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.343478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52e4e9c188f486bb5f1ba602f04a443', 'request_id': 'req-330373a4-bb24-4201-9784-3d47319b6035'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.353130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52e4e9c188f486bb5f1ba602f04a443', 'request_id': 'req-330373a4-bb24-4201-9784-3d47319b6035'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.364153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] The token cache is being invalidate because project f52e4e9c188f486bb5f1ba602f04a443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:46.364433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.365143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.367020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 965/1924] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:46 2021] DELETE /identity/v3/projects/f52e4e9c188f486bb5f1ba602f04a443 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:46.371039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:46.380570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a431b83-3d03-44c7-a01c-80385d1de794 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:46.439769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:46.440849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:46.441278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:46.441560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] PATH_INFO: `/v3/users/25895d8e541646a9aa730b1b9304a0a1` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:46.442823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25895d8e541646a9aa730b1b9304a0a1)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:46.444743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:46.494339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25895d8e541646a9aa730b1b9304a0a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.503397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25895d8e541646a9aa730b1b9304a0a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.511649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25895d8e541646a9aa730b1b9304a0a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.525467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25895d8e541646a9aa730b1b9304a0a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.526223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b53e5e61-b7ad-4162-9d8e-64b17f6a0f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25895d8e541646a9aa730b1b9304a0a1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:46.532717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 960/1925] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:46 2021] DELETE /identity/v3/users/25895d8e541646a9aa730b1b9304a0a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:46.822043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:46.824107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:46.843124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330373a4-bb24-4201-9784-3d47319b6035 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:46.948671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:46.949954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:46.950433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:46.950878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] PATH_INFO: `/v3/users/d51f4860ab434bac8cb1a2f1d551123f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:46.952509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51f4860ab434bac8cb1a2f1d551123f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:46.955358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.027714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51f4860ab434bac8cb1a2f1d551123f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.042076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51f4860ab434bac8cb1a2f1d551123f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.054754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51f4860ab434bac8cb1a2f1d551123f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.056430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51f4860ab434bac8cb1a2f1d551123f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.074603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51f4860ab434bac8cb1a2f1d551123f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.083155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 966/1926] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:46 2021] DELETE /identity/v3/users/d51f4860ab434bac8cb1a2f1d551123f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:47.089143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.090310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.090740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.121689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:47.124869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.212885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 961/1927] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:47.228745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.230687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.280336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.282363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.298333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7d52-4972-4bea-869c-d80a3f9e04c0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.320384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.322037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.322384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.322663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] PATH_INFO: `/v3/projects/4834372aec7f44a4841514204fd5e4e5` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.324071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4834372aec7f44a4841514204fd5e4e5)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.326215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.366248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff630a-b4e6-46c6-9197-b22874f58859 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.370827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6540dc-47b8-4db8-96e3-0be3762ce4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.371684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6540dc-47b8-4db8-96e3-0be3762ce4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.372063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6540dc-47b8-4db8-96e3-0be3762ce4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.372433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6540dc-47b8-4db8-96e3-0be3762ce4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.386635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6540dc-47b8-4db8-96e3-0be3762ce4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.388639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6540dc-47b8-4db8-96e3-0be3762ce4d9 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.405660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 967/1928] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:47.426902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4834372aec7f44a4841514204fd5e4e5', 'request_id': 'req-65080e6a-8298-4186-aa49-d825ac51734d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.441305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4834372aec7f44a4841514204fd5e4e5', 'request_id': 'req-65080e6a-8298-4186-aa49-d825ac51734d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.453223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4834372aec7f44a4841514204fd5e4e5', 'request_id': 'req-65080e6a-8298-4186-aa49-d825ac51734d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.467817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] The token cache is being invalidate because project 4834372aec7f44a4841514204fd5e4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:47.468103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.468942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-65080e6a-8298-4186-aa49-d825ac51734d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:47.470537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 962/1929] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:47 2021] DELETE /identity/v3/projects/4834372aec7f44a4841514204fd5e4e5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:47.476735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.477491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.477491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.510389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:47.512151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.592274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 968/1930] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:47.602064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.602323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.602562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.624887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:47.626118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.638795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 963/1931] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:47.640865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.655465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e641f-bc12-4a93-95e3-88a0fba2bec3 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.661698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.662702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.663187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.663978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.665967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:47.666497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.669649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.689182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 969/1932] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:47.689818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.713293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b25ff-cb9e-40a6-9149-92f995b6d3cc None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.730092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.730797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.731080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.731356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.732074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.734290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.801947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 964/1933] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:47 2021] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:47.803726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.818313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.824446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e97c55-ebaf-4bc0-af9c-9ea8341fff53 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.826975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.906445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.907158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.907434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.907708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.908428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.911762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.931413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db861c-9f78-4fe2-887a-b63b387f5355 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.941274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.942185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.942467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.942743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] PATH_INFO: `/v3/projects/befd8eb6614b4ac8843054c98256f28c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.943972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=befd8eb6614b4ac8843054c98256f28c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.944934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 970/1934] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:47 2021] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:47.946009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:47.946109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:47.948907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:47.967319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17467-84d5-447c-9019-9db8a97ce294 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:47.987901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:47.989453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:47.989746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:47.990236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] PATH_INFO: `/v3/users/f1078451d5f54a42b8692182f778b203` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:47.991639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1078451d5f54a42b8692182f778b203)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:47.994410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.008887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befd8eb6614b4ac8843054c98256f28c', 'request_id': 'req-6141ad91-cdc0-417f-9a15-6cc5b9128d11'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.016363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befd8eb6614b4ac8843054c98256f28c', 'request_id': 'req-6141ad91-cdc0-417f-9a15-6cc5b9128d11'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.028525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befd8eb6614b4ac8843054c98256f28c', 'request_id': 'req-6141ad91-cdc0-417f-9a15-6cc5b9128d11'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.043423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] The token cache is being invalidate because project befd8eb6614b4ac8843054c98256f28c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:48.043898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.044613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.046647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 965/1935] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:47 2021] DELETE /identity/v3/projects/befd8eb6614b4ac8843054c98256f28c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:48.047576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.048921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.070407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1078451d5f54a42b8692182f778b203'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.084525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1078451d5f54a42b8692182f778b203'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.094705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1078451d5f54a42b8692182f778b203'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.095463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1078451d5f54a42b8692182f778b203'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.113473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1078451d5f54a42b8692182f778b203'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.119638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 971/1936] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:47 2021] DELETE /identity/v3/users/f1078451d5f54a42b8692182f778b203 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:48.120508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.121453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141ad91-cdc0-417f-9a15-6cc5b9128d11 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.121967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.193529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.194626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.194912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.195186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] PATH_INFO: `/v3/users/7f8f6f36e94f4f7e98326cc43f39bee6` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.196750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8f6f36e94f4f7e98326cc43f39bee6)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.198773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.212949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129101-7e9a-4135-b1cf-899a36729a8c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.220439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e503186-229d-4629-aefa-78a9ebee887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.221346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503186-229d-4629-aefa-78a9ebee887a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.222330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503186-229d-4629-aefa-78a9ebee887a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.222612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503186-229d-4629-aefa-78a9ebee887a admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.223371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e503186-229d-4629-aefa-78a9ebee887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.225718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e503186-229d-4629-aefa-78a9ebee887a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.243438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 972/1937] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:48.244945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d815c-c62d-40f6-aefe-61895268eeb2 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.245183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d815c-c62d-40f6-aefe-61895268eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.245529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d815c-c62d-40f6-aefe-61895268eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.262696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8f6f36e94f4f7e98326cc43f39bee6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.269619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8a3d815c-c62d-40f6-aefe-61895268eeb2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:48.271528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8a3d815c-c62d-40f6-aefe-61895268eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.273718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8f6f36e94f4f7e98326cc43f39bee6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.282632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8f6f36e94f4f7e98326cc43f39bee6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.289618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 973/1938] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:48.289618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6bc9-462b-473c-9ec1-ef96011c6502 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.289618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6bc9-462b-473c-9ec1-ef96011c6502 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.289618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6bc9-462b-473c-9ec1-ef96011c6502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.304320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8f6f36e94f4f7e98326cc43f39bee6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.306367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8f6f36e94f4f7e98326cc43f39bee6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:48.316097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cacb6bc9-462b-473c-9ec1-ef96011c6502 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:48.317620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 966/1939] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:48 2021] DELETE /identity/v3/users/7f8f6f36e94f4f7e98326cc43f39bee6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:48.317916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cacb6bc9-462b-473c-9ec1-ef96011c6502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.318786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.321727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.389820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 974/1940] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:48.393030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.394115 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.394578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.397618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1ce1-192f-48ad-b3c4-ca9d8d68b67c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.404884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad5a5c-e2f5-4362-a724-aff8369ebb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.405550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5a5c-e2f5-4362-a724-aff8369ebb35 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.405838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5a5c-e2f5-4362-a724-aff8369ebb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.406229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5a5c-e2f5-4362-a724-aff8369ebb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.406928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5a5c-e2f5-4362-a724-aff8369ebb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.408533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5a5c-e2f5-4362-a724-aff8369ebb35 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.419540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 967/1941] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:48.420856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.421145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.421543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.422390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:48.423731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.436613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 975/1942] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:48.439935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.441844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.445594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:48.446131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.464957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 968/1943] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:48.466006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.477456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfcc1d-b1b6-4c85-a2df-9564252a5a0f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.483827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.484806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.485221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.485565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] PATH_INFO: `/v3/projects/7fdd7572582c4f72ab236de838a570a6/users/c6f889a7f5294815853dd7aea20c703b/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.504040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdd7572582c4f72ab236de838a570a6, user_id=c6f889a7f5294815853dd7aea20c703b, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.506757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.523751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9a69-836f-497d-b533-0524b6920aff None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.532199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 969/1944] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:48 2021] PUT /identity/v3/projects/7fdd7572582c4f72ab236de838a570a6/users/c6f889a7f5294815853dd7aea20c703b/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:48.532199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.586264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.586915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.587181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.587448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.599204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb837-cd0f-4700-886a-7d072a47ec70 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.604264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.605339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.605624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.605899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.606704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:48.607008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.608611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.620681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 970/1945] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:48.624868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.634493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea941a-b616-438a-915d-2fe5b49c1f1e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.639250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ea0f2-71f4-4946-a934-b6dfb7aa81f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.639865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea0f2-71f4-4946-a934-b6dfb7aa81f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.640162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea0f2-71f4-4946-a934-b6dfb7aa81f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.640779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea0f2-71f4-4946-a934-b6dfb7aa81f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.650339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ea0f2-71f4-4946-a934-b6dfb7aa81f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.650919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.651749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ea0f2-71f4-4946-a934-b6dfb7aa81f9 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.652357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.662910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 971/1946] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:48.663406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 976/1947] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:48.664039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.664145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.664330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.664616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.673740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32bf37-5072-45bb-bda5-acbb1ac6c151 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.679188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.680381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.680381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.680381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.681084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.683205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.692490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] MFA Rules not processed for user `c6f889a7f5294815853dd7aea20c703b`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:48.693860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.739300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 977/1948] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:48.743221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.818003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 972/1949] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:48.830713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.833718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:48.887146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2589c3-44e0-4b49-a227-b9de1fa516b8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.896838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.897992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.898258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.898664 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.899672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.902686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.937349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1510562-9db2-484d-bdfa-d7b1fb92ae5c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.937940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 978/1950] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:48 2021] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:48.942542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:48.958397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3559ef2-6ccd-4b31-b17d-0ad6e69646b0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:48.964453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:48.965660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:48.966049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:48.966470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:48.967646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:48.970179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:48.984137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 979/1951] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:48.990487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.001078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77410743-d2c3-404f-9a25-5eb43872b13c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:49.006732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:49.007660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.008057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.008606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.009160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807f22f-4310-4c72-967b-b16c162c9f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:49.009350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:49.010345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f22f-4310-4c72-967b-b16c162c9f37 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.010775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f22f-4310-4c72-967b-b16c162c9f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.010991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:49.011359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f22f-4310-4c72-967b-b16c162c9f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.027293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 980/1952] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:49.029584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.040943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e16be2-bdb2-491e-a444-e10edb8ea28b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:49.056069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:49.057289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.057570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.057847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] PATH_INFO: `/v3/projects/e65fe36399a34538b3b4da9464f43df3/users/047982e41574460caa4bf3b79a9a8370/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.089489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65fe36399a34538b3b4da9464f43df3, user_id=047982e41574460caa4bf3b79a9a8370, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:49.092387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:49.094599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807f22f-4310-4c72-967b-b16c162c9f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:49.096296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807f22f-4310-4c72-967b-b16c162c9f37 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:49.108195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 973/1953] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:48 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:49.116296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 981/1954] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:49 2021] PUT /identity/v3/projects/e65fe36399a34538b3b4da9464f43df3/users/047982e41574460caa4bf3b79a9a8370/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:49.117659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.117955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.118258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.138033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:49.139208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:49.214326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 974/1955] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:49.225318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.227297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:49.310923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fe6a3-4be8-4566-af03-ff2377c0d028 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:49.324537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:49.328054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.328362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.328633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.353294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:49.358405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:49.395718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 982/1956] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:49.679107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.686291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:49.707200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.708649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:49.721029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb840d-02d9-4812-8e67-2bd514423407 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:49.728551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebebc76-86e0-485a-8412-43743e69cbcf service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:49.732130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:49.733138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.733402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.733673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] PATH_INFO: `/v3/projects/f4ad59e1b54d4505a748bf2c55fc373a` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.735376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ad59e1b54d4505a748bf2c55fc373a)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:49.737446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:49.742743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:49.743616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:49.743906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:49.744165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] PATH_INFO: `/v3/projects/da44cc1ee4cd4bbb9330b30af53d15bb` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:49.749060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da44cc1ee4cd4bbb9330b30af53d15bb)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:49.751037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:49.846315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ad59e1b54d4505a748bf2c55fc373a', 'request_id': 'req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.848503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da44cc1ee4cd4bbb9330b30af53d15bb', 'request_id': 'req-a66bd85c-5027-42ff-b495-f97fedb6548c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.860075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ad59e1b54d4505a748bf2c55fc373a', 'request_id': 'req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.861558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da44cc1ee4cd4bbb9330b30af53d15bb', 'request_id': 'req-a66bd85c-5027-42ff-b495-f97fedb6548c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.887204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da44cc1ee4cd4bbb9330b30af53d15bb', 'request_id': 'req-a66bd85c-5027-42ff-b495-f97fedb6548c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.894839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ad59e1b54d4505a748bf2c55fc373a', 'request_id': 'req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.947290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] The token cache is being invalidate because project da44cc1ee4cd4bbb9330b30af53d15bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:49.947494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] The token cache is being invalidate because project f4ad59e1b54d4505a748bf2c55fc373a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:49.947587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.947762 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.948245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.949467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:49.950442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 983/1957] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:49 2021] DELETE /identity/v3/projects/da44cc1ee4cd4bbb9330b30af53d15bb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:49.955084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 975/1958] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:49 2021] DELETE /identity/v3/projects/f4ad59e1b54d4505a748bf2c55fc373a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:49.958653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.959141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:49.960537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:49.961475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:50.059972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d310c5-2822-4278-b1ed-7a1e4a7d49a0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:50.116761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bd85c-5027-42ff-b495-f97fedb6548c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:50.127988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:50.129137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:50.129579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:50.130007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] PATH_INFO: `/v3/users/a7b3684fa67f42fe8d226b144c0cc079` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:50.132280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b3684fa67f42fe8d226b144c0cc079)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:50.137913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:50.170454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:50.172871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:50.173146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:50.173418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] PATH_INFO: `/v3/users/97e36c4c47e849fca55e742249987d66` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:50.174765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e36c4c47e849fca55e742249987d66)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:50.176756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:50.220247 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b3684fa67f42fe8d226b144c0cc079'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.231443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b3684fa67f42fe8d226b144c0cc079'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.243064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b3684fa67f42fe8d226b144c0cc079'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.244065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b3684fa67f42fe8d226b144c0cc079'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.249953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e36c4c47e849fca55e742249987d66'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.270046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e36c4c47e849fca55e742249987d66'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.277751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e6b6c8a5-d8c2-4ce7-80eb-219ed49d7885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b3684fa67f42fe8d226b144c0cc079'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.282082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e36c4c47e849fca55e742249987d66'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.289564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 984/1959] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:49 2021] DELETE /identity/v3/users/a7b3684fa67f42fe8d226b144c0cc079 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:50.303155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e36c4c47e849fca55e742249987d66'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.303894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e36c4c47e849fca55e742249987d66'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.311600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 976/1960] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:49 2021] DELETE /identity/v3/users/97e36c4c47e849fca55e742249987d66 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:50.523760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:50.524257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:50.524856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:50.598427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] MFA Rules not processed for user `047982e41574460caa4bf3b79a9a8370`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:50.603065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:50.731570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:50.733579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:50.752442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 985/1961] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:50 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:50.767689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:50.770956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:50.843678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cc70e-350d-45d8-b1fc-fdd31b770cf4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:50.849537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:50.850441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:50.850721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:50.850992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] PATH_INFO: `/v3/projects/2aeb7accb2d04acd997a07b6ef57c872` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:50.852472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aeb7accb2d04acd997a07b6ef57c872)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:50.854473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:50.891085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b7b0-2ddd-466a-a3b3-465d38f811b4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:50.897534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:50.898941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:50.898941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:50.899168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] PATH_INFO: `/v3/projects/46fb4ae26d2940b6877d17f129165b39` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:50.900451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fb4ae26d2940b6877d17f129165b39)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:50.902798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:50.932719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aeb7accb2d04acd997a07b6ef57c872', 'request_id': 'req-6b9b140d-c6dc-432a-879b-4ac95495eb22'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.940353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aeb7accb2d04acd997a07b6ef57c872', 'request_id': 'req-6b9b140d-c6dc-432a-879b-4ac95495eb22'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.953076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aeb7accb2d04acd997a07b6ef57c872', 'request_id': 'req-6b9b140d-c6dc-432a-879b-4ac95495eb22'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.958987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fb4ae26d2940b6877d17f129165b39', 'request_id': 'req-dc117580-63cd-470a-b98f-a5397cea4f84'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.965243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] The token cache is being invalidate because project 2aeb7accb2d04acd997a07b6ef57c872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:50.965563 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fb4ae26d2940b6877d17f129165b39', 'request_id': 'req-dc117580-63cd-470a-b98f-a5397cea4f84'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.965678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.966410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.968826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 977/1962] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:50 2021] DELETE /identity/v3/projects/2aeb7accb2d04acd997a07b6ef57c872 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:50.969888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:50.972432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:50.976296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fb4ae26d2940b6877d17f129165b39', 'request_id': 'req-dc117580-63cd-470a-b98f-a5397cea4f84'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.986636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] The token cache is being invalidate because project 46fb4ae26d2940b6877d17f129165b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:50.986925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.987622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dc117580-63cd-470a-b98f-a5397cea4f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:50.989163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 986/1963] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:50 2021] DELETE /identity/v3/projects/46fb4ae26d2940b6877d17f129165b39 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:50.990506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2c79c-45e7-4261-a272-694944f119aa None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:50.990787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2c79c-45e7-4261-a272-694944f119aa None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:50.991060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2c79c-45e7-4261-a272-694944f119aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.008879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-dff2c79c-45e7-4261-a272-694944f119aa None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:51.010079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-dff2c79c-45e7-4261-a272-694944f119aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.030890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b140d-c6dc-432a-879b-4ac95495eb22 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.067038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 987/1964] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:51.068634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be063c4e-53fa-45c9-b9f2-83c53dbc5d9a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.068918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be063c4e-53fa-45c9-b9f2-83c53dbc5d9a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.069187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be063c4e-53fa-45c9-b9f2-83c53dbc5d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.087753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.088336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.088681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.089020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.091361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.096111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-be063c4e-53fa-45c9-b9f2-83c53dbc5d9a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:51.099591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-be063c4e-53fa-45c9-b9f2-83c53dbc5d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.123926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 988/1965] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:51.125386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcaeb4-0750-4322-a06d-9e57ba1bcb2f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.125666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcaeb4-0750-4322-a06d-9e57ba1bcb2f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.125939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcaeb4-0750-4322-a06d-9e57ba1bcb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.146074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a4fcaeb4-0750-4322-a06d-9e57ba1bcb2f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:51.147561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a4fcaeb4-0750-4322-a06d-9e57ba1bcb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.155512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 989/1966] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:51.156983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.157273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.157580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.160105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.161642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.172268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 978/1967] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:50 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:51.177335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:51.178574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.179472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.189078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 990/1968] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:51.194185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.195038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a118-56d0-43f8-805e-aa59cd99c6ae service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.201735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.202785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.203202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.203553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.212475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:51.212574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb90bf8-2a4c-487d-a927-8e0031e6d6d8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.212662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.212662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.212827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.212827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.212827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.212827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.213147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:51.213147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.213792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.219473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 979/1969] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:51.224349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.230191 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 991/1970] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:51.231480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.240345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea9ea-e48c-45d5-9552-501ceb1b3739 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.242314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f036f7-e416-4bdb-904d-f36dcd25b3a4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.246893 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.247049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.247906 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.248265 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.248387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.248712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.248966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.249399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.249643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.250883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.251828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.254138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.281640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 992/1971] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:51.285774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.290237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 980/1972] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:51.291028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.359252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff83734-01fb-4e14-950d-eac72ae9e94b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.364376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.365204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.365557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.365908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.366959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.368604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c594997-b10d-4a61-9ef4-b017d87d046e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.369153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.373604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.374370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.374723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.375065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.375835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.378385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.392651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 993/1973] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:51.397645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.405819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 981/1974] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:51.406969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.412024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0f554-e80b-48b6-93a1-aa3d461be7e4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.417318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3e4e7-2b94-4c75-a6f2-520c6a953e1d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.417690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.418227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.418508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.418818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.419568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.421327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.423062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.423724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.424008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.424282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.425075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.426798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.434252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 994/1975] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:51.442613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 982/1976] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:51.447188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.448671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.463004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae8e6-86bf-4b58-a46a-6c95268e7bae admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.463551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d72a2a-b514-433e-a56d-59adafab647f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.468587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.469409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.469890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.470325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.471353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.473447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.474829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.475493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.475769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.476038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.476844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.479481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.487832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 995/1977] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:51.496854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 983/1978] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:51.499628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.499777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.511183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccba03-9672-47fb-9719-c2ebecbd97b5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.511700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dd50-c790-401a-bb70-1821f082ae5d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.516115 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3ae78-e8fe-4c8a-bf7d-d442e4965f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.516827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba1766-9743-4e40-883c-2c74e1bc9718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.516995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ae78-e8fe-4c8a-bf7d-d442e4965f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.517282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ae78-e8fe-4c8a-bf7d-d442e4965f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.517559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3ae78-e8fe-4c8a-bf7d-d442e4965f06 admin admin] PATH_INFO: `/v3/projects/6ef476cbf6734e2d9466bbb1023a4682/users/183b8ab2b0884baf90bd3143ea424afa/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.518500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba1766-9743-4e40-883c-2c74e1bc9718 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.519517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba1766-9743-4e40-883c-2c74e1bc9718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.519775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba1766-9743-4e40-883c-2c74e1bc9718 admin admin] PATH_INFO: `/v3/projects/e9950e9625284109858b444a485b28cc/users/570237ab54a048eba79d5dabbc82e9cf/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.537213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ae78-e8fe-4c8a-bf7d-d442e4965f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef476cbf6734e2d9466bbb1023a4682, user_id=183b8ab2b0884baf90bd3143ea424afa, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.537362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba1766-9743-4e40-883c-2c74e1bc9718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9950e9625284109858b444a485b28cc, user_id=570237ab54a048eba79d5dabbc82e9cf, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.539960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3ae78-e8fe-4c8a-bf7d-d442e4965f06 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.540085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba1766-9743-4e40-883c-2c74e1bc9718 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.553802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 984/1979] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:51 2021] PUT /identity/v3/projects/e9950e9625284109858b444a485b28cc/users/570237ab54a048eba79d5dabbc82e9cf/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:51.554342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 996/1980] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:51 2021] PUT /identity/v3/projects/6ef476cbf6734e2d9466bbb1023a4682/users/183b8ab2b0884baf90bd3143ea424afa/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:51.564883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.565165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.566053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.566329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.566645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.566924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.591557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] MFA Rules not processed for user `183b8ab2b0884baf90bd3143ea424afa`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:51.592751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.593461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] MFA Rules not processed for user `570237ab54a048eba79d5dabbc82e9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:51.594658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:51.654434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 985/1981] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:51.657508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 997/1982] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:51.661716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.661885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.721960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620b8e5-da03-44ed-aef7-db72fa82e259 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.723693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd771db-0f64-40e0-8f8d-1cfa66eddf57 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.726888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.727484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.727841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.728039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.729146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.729294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.729796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.730074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.730374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.731078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.731237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.732996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.760416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 986/1983] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:51.760629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 998/1984] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:51.761531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.762573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.822025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9df93-2668-48d8-a73a-1ae516a46ab7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.823309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a1640-1615-4bb9-a292-3e44b8dcbeac admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.827122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.827789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.827900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.828068 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.828339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.828523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.828802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.829033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.829130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.829761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.831097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.831977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.851493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 987/1985] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:51.851662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 999/1986] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:51 2021] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:51.855334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.857951 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.865405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3a0c-17c0-4fdc-9739-504465a4cc87 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.868032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971dd56f-1f08-46ab-ba04-d7d7ab8e6727 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.870090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.870757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.871033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.871304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.872026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.873355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.873597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.873999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.874324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.874603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.875347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.876926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.884112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 988/1987] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:51.887945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.889438 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1000/1988] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:51.893423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.898252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f1dd9-4e48-4e14-8354-bd1f7d31302f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.903051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb48a3-7fea-4c31-814e-24d6983c0889 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:51.903179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.903977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.904253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.904790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] PATH_INFO: `/v3/projects/17d5b66d7d9b4794bc818efc34cf2d36/users/1ba79f81ab0645e896614fdd39dacda1/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.907986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:51.908847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:51.909659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:51.909937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] PATH_INFO: `/v3/projects/b8a819306b2c435c8fad8b482c8ab809/users/363f390f01a24e7a8db1685a96e51f28/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:51.920499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d5b66d7d9b4794bc818efc34cf2d36, user_id=1ba79f81ab0645e896614fdd39dacda1, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.923364 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.925709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a819306b2c435c8fad8b482c8ab809, user_id=363f390f01a24e7a8db1685a96e51f28, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:51.928992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:51.941472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 989/1989] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:51 2021] PUT /identity/v3/projects/17d5b66d7d9b4794bc818efc34cf2d36/users/1ba79f81ab0645e896614fdd39dacda1/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:51.942680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1001/1990] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:51 2021] PUT /identity/v3/projects/b8a819306b2c435c8fad8b482c8ab809/users/363f390f01a24e7a8db1685a96e51f28/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:51.945750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:51.946448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.005043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d089a-348d-4160-9e5a-18f4698ae3d8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.005534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf574-950c-4c6d-ac90-5d4399e5a919 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.009760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.010227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.010445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.010727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.010885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.011000 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.011168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.011442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.011727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.012173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.013435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.013871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.023514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 990/1991] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:52.026854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1002/1992] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:51 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:52.027620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.027770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.037377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba1ba4-f3e1-47c9-b6be-73a5ae412bf1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.037507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b40fa-cf75-48f7-a177-72ee7f77f4f3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.041885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f845-4648-4a9e-b85c-f4d4bd061554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.042023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee998f-74c8-49cb-850e-546788dd764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.042755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f845-4648-4a9e-b85c-f4d4bd061554 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.042865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee998f-74c8-49cb-850e-546788dd764b admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.043037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f845-4648-4a9e-b85c-f4d4bd061554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.043149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee998f-74c8-49cb-850e-546788dd764b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.043306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f845-4648-4a9e-b85c-f4d4bd061554 admin admin] PATH_INFO: `/v3/projects/17d5b66d7d9b4794bc818efc34cf2d36/users/1ba79f81ab0645e896614fdd39dacda1/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.043422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee998f-74c8-49cb-850e-546788dd764b admin admin] PATH_INFO: `/v3/projects/b8a819306b2c435c8fad8b482c8ab809/users/363f390f01a24e7a8db1685a96e51f28/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.045267 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f845-4648-4a9e-b85c-f4d4bd061554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d5b66d7d9b4794bc818efc34cf2d36, user_id=1ba79f81ab0645e896614fdd39dacda1, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.045442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee998f-74c8-49cb-850e-546788dd764b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a819306b2c435c8fad8b482c8ab809, user_id=363f390f01a24e7a8db1685a96e51f28, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.047918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f845-4648-4a9e-b85c-f4d4bd061554 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.048162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee998f-74c8-49cb-850e-546788dd764b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.058472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 991/1993] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:52 2021] PUT /identity/v3/projects/17d5b66d7d9b4794bc818efc34cf2d36/users/1ba79f81ab0645e896614fdd39dacda1/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:52.059274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1003/1994] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:52 2021] PUT /identity/v3/projects/b8a819306b2c435c8fad8b482c8ab809/users/363f390f01a24e7a8db1685a96e51f28/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:52.070260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161597b-3549-4882-a253-af362c45a9ac None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.070431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.070657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161597b-3549-4882-a253-af362c45a9ac None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.070768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.070947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161597b-3549-4882-a253-af362c45a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.071034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.097254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e161597b-3549-4882-a253-af362c45a9ac None None] MFA Rules not processed for user `363f390f01a24e7a8db1685a96e51f28`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:52.097834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] MFA Rules not processed for user `1ba79f81ab0645e896614fdd39dacda1`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:52.098527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e161597b-3549-4882-a253-af362c45a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.099408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.164304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 992/1995] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:52 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:52.164870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1004/1996] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:52 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:52.174617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.175139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161597b-3549-4882-a253-af362c45a9ac None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.176049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.176224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e161597b-3549-4882-a253-af362c45a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.230841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161597b-3549-4882-a253-af362c45a9ac None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.232136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305620f-8300-4684-bb01-59fcbd10c95c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.234506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.235175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.235450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.235717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.235884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46dc71-68d8-48d7-b0da-b5ee4fbaaeb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.236533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dc71-68d8-48d7-b0da-b5ee4fbaaeb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.236816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dc71-68d8-48d7-b0da-b5ee4fbaaeb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.237115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46dc71-68d8-48d7-b0da-b5ee4fbaaeb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.244636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.246050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.256989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1005/1997] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:52 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:52.285512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.295129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46dc71-68d8-48d7-b0da-b5ee4fbaaeb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.296565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46dc71-68d8-48d7-b0da-b5ee4fbaaeb1 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.306937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 993/1998] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:52 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:52.348771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc93bb7-1de1-47dd-843a-0bc2dc78fd4f service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.353437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.354335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.354618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.354890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] PATH_INFO: `/v3/users/183b8ab2b0884baf90bd3143ea424afa` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.356102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=183b8ab2b0884baf90bd3143ea424afa)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.358013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.404055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183b8ab2b0884baf90bd3143ea424afa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.411249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183b8ab2b0884baf90bd3143ea424afa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.418278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183b8ab2b0884baf90bd3143ea424afa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.418956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183b8ab2b0884baf90bd3143ea424afa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.431227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183b8ab2b0884baf90bd3143ea424afa'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.437151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1006/1999] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:52 2021] DELETE /identity/v3/users/183b8ab2b0884baf90bd3143ea424afa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:52.442760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.443043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.443346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.461394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:52.462727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.527027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 994/2000] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:52.537633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.539222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.611235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09f0a2-a5a1-4104-b83c-0d21a67b01cc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.615961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.616601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.616879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.617149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.626101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.627559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.638889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1007/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:52.895961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:52.897888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:52.914220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad99ec-3b8b-4638-b9a3-5e2b00359c90 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:52.919255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:52.920002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:52.920288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:52.920617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] PATH_INFO: `/v3/projects/6ef476cbf6734e2d9466bbb1023a4682` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:52.921733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef476cbf6734e2d9466bbb1023a4682)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:52.923730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:52.969271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef476cbf6734e2d9466bbb1023a4682', 'request_id': 'req-c94170c1-092f-47e3-807e-e21fe43fb65b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.975614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef476cbf6734e2d9466bbb1023a4682', 'request_id': 'req-c94170c1-092f-47e3-807e-e21fe43fb65b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.982922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef476cbf6734e2d9466bbb1023a4682', 'request_id': 'req-c94170c1-092f-47e3-807e-e21fe43fb65b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.994701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] The token cache is being invalidate because project 6ef476cbf6734e2d9466bbb1023a4682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:52.995013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.995673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:52.997218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 995/2002] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:52 2021] DELETE /identity/v3/projects/6ef476cbf6734e2d9466bbb1023a4682 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:53.001138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.010899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c25c3-b7a5-4a71-a150-c85bfabbdc0f service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.065952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.066766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.067070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.067340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] PATH_INFO: `/v3/users/363f390f01a24e7a8db1685a96e51f28` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.068557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=363f390f01a24e7a8db1685a96e51f28)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.070581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.115066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363f390f01a24e7a8db1685a96e51f28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.122935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363f390f01a24e7a8db1685a96e51f28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.130474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363f390f01a24e7a8db1685a96e51f28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.131151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363f390f01a24e7a8db1685a96e51f28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.142481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-dde05e43-2fe9-4da1-a5c5-7f8beb545c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363f390f01a24e7a8db1685a96e51f28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.148513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1008/2003] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:53 2021] DELETE /identity/v3/users/363f390f01a24e7a8db1685a96e51f28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:53.409971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.411490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:53.427114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94170c1-092f-47e3-807e-e21fe43fb65b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.482438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.483288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.483561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.483829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] PATH_INFO: `/v3/projects/b8a819306b2c435c8fad8b482c8ab809` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.484997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a819306b2c435c8fad8b482c8ab809)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.486913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.530444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a819306b2c435c8fad8b482c8ab809', 'request_id': 'req-f8809cc6-b448-4568-8f97-ed54108ad1e6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.536648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a819306b2c435c8fad8b482c8ab809', 'request_id': 'req-f8809cc6-b448-4568-8f97-ed54108ad1e6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.543411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a819306b2c435c8fad8b482c8ab809', 'request_id': 'req-f8809cc6-b448-4568-8f97-ed54108ad1e6'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.553846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] The token cache is being invalidate because project b8a819306b2c435c8fad8b482c8ab809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:53.554127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.554775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f8809cc6-b448-4568-8f97-ed54108ad1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:53.556289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 996/2004] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:53 2021] DELETE /identity/v3/projects/b8a819306b2c435c8fad8b482c8ab809 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:53.562113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.562493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.562835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.580757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:53.582002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:53.640255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1009/2005] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:53.648430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.648719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.648997 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.667490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:53.668688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:53.677173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 997/2006] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:53.681296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.690764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c36d30-6a6b-47d4-a3f6-a08c2f94c66a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.695342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.695988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.696275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.696548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.697286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:53.697596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.699225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.710372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1010/2007] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:53.714466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.724582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e6c99-7746-4255-8d00-65594bd9b50c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.729285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.729924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.730236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.730509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.731216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.733088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.758086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 998/2008] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:53 2021] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:53.762076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.772092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f379d8-7f0c-423c-bccc-d86596de5a8a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.832500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.833164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.833441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.833708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.834452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.836337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.857368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1011/2009] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:53 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:53.861403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.871489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b213d1d-96b0-42a3-8bad-f43c84a1d60c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.876192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.876883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.877168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.877445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.878214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.879812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.889834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 999/2010] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:53.894218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.904035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c4a62-25b0-4618-9161-aeca52593421 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.909550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9635e20-1cae-4742-bb53-0a74b3aa975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.910242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635e20-1cae-4742-bb53-0a74b3aa975b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.910529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635e20-1cae-4742-bb53-0a74b3aa975b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.910808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635e20-1cae-4742-bb53-0a74b3aa975b admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.911550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9635e20-1cae-4742-bb53-0a74b3aa975b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.913125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9635e20-1cae-4742-bb53-0a74b3aa975b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.924625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1012/2011] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:53.928910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:53.940193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe01ad-3c7c-41f7-9da0-7707a4994f85 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:53.944724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:53.945576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.945846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.946117 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] PATH_INFO: `/v3/projects/55ca6c7cc869441081728acca3c82c70/users/adbed8a06d92481fa3207d1f8a4b1047/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:53.960337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ca6c7cc869441081728acca3c82c70, user_id=adbed8a06d92481fa3207d1f8a4b1047, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:53.962981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:53.977371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1000/2012] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:53 2021] PUT /identity/v3/projects/55ca6c7cc869441081728acca3c82c70/users/adbed8a06d92481fa3207d1f8a4b1047/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:53.987668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:53.987957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:53.988238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.014336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] MFA Rules not processed for user `adbed8a06d92481fa3207d1f8a4b1047`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:54.015540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:54.079772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1013/2013] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:53 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:54.085159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.146674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cb949-4aad-4379-a40a-4f4b12c43274 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.151325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.151977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.152278 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.152538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.153251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.155193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.179837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1001/2014] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:54 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:54.183952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.195019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bb045-7e71-4153-977c-ad1e97ba9601 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.247565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.248218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.248497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.248773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.249504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.251719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.274965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1014/2015] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:54 2021] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:54.279059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.289255 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299941c4-802d-4a76-833d-6ae70e0009c6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.294924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.295582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.295864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.296131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.296886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.298545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.309767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1002/2016] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:54.314068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.324510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa1698-27df-41a4-a3b8-d0448ae510ad admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.329211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.330101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.330409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.330684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] PATH_INFO: `/v3/projects/2858e27c4efa471b9e1636759551de1c/users/d8cfa9ca137c481d9f2362fb822e23a9/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.346916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2858e27c4efa471b9e1636759551de1c, user_id=d8cfa9ca137c481d9f2362fb822e23a9, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.349606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.363908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1015/2017] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:54 2021] PUT /identity/v3/projects/2858e27c4efa471b9e1636759551de1c/users/d8cfa9ca137c481d9f2362fb822e23a9/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:54.367962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.379254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aac094-91ba-49b6-bd19-27332b5d3daa admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.439472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2d8e0-6cde-4851-a991-4945e53ef5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.440446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d8e0-6cde-4851-a991-4945e53ef5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.440446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d8e0-6cde-4851-a991-4945e53ef5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.440758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2d8e0-6cde-4851-a991-4945e53ef5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.441451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2d8e0-6cde-4851-a991-4945e53ef5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.443086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2d8e0-6cde-4851-a991-4945e53ef5fc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.453912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1003/2018] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:54 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:54.458550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.469180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e3bd7-9145-48f7-b5c7-e84945de9452 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.474977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.475966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.476318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.476661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] PATH_INFO: `/v3/projects/2858e27c4efa471b9e1636759551de1c/users/d8cfa9ca137c481d9f2362fb822e23a9/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.478916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2858e27c4efa471b9e1636759551de1c, user_id=d8cfa9ca137c481d9f2362fb822e23a9, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.481740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.494132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1016/2019] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:54 2021] PUT /identity/v3/projects/2858e27c4efa471b9e1636759551de1c/users/d8cfa9ca137c481d9f2362fb822e23a9/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:54.506103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb8fd0-4115-475a-baed-ada34b6dcf76 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.506492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb8fd0-4115-475a-baed-ada34b6dcf76 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.506839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb8fd0-4115-475a-baed-ada34b6dcf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.532808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-43fb8fd0-4115-475a-baed-ada34b6dcf76 None None] MFA Rules not processed for user `d8cfa9ca137c481d9f2362fb822e23a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:54.534550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-43fb8fd0-4115-475a-baed-ada34b6dcf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:54.600111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1004/2020] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:54 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:54.610242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.611771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:54.662112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780684d0-20d8-4150-8d9c-a2c07cd901f8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.662405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780684d0-20d8-4150-8d9c-a2c07cd901f8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.662641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780684d0-20d8-4150-8d9c-a2c07cd901f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.674443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a821-2903-488e-8dcc-b8e53d9aec59 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.678182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.678824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.679112 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.679382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.681747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-780684d0-20d8-4150-8d9c-a2c07cd901f8 None None] MFA Rules not processed for user `047982e41574460caa4bf3b79a9a8370`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:54.683021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-780684d0-20d8-4150-8d9c-a2c07cd901f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:54.689711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.691474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.703046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1017/2021] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:54 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:54.761326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1005/2022] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:54 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:54.832641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:54.911969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abd9d1-9227-48ea-aa56-c15046a7db18 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:54.922113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:54.923059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:54.923347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:54.923627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] PATH_INFO: `/v3/users/adbed8a06d92481fa3207d1f8a4b1047` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:54.924977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbed8a06d92481fa3207d1f8a4b1047)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:54.927146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:54.984371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbed8a06d92481fa3207d1f8a4b1047'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.004539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbed8a06d92481fa3207d1f8a4b1047'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.013676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbed8a06d92481fa3207d1f8a4b1047'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.014520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbed8a06d92481fa3207d1f8a4b1047'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.036822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbed8a06d92481fa3207d1f8a4b1047'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.048547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1018/2023] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:54 2021] DELETE /identity/v3/users/adbed8a06d92481fa3207d1f8a4b1047 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:55.053320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:55.053608 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:55.053895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:55.087044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:55.091929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:55.197811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1006/2024] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:55.211559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:55.213141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:55.292580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8a252-1340-43ac-8994-abe7492b6b76 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:55.296089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:55.296729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:55.297074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:55.297342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:55.307773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:55.309257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:55.320147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1019/2025] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:55.633279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:55.635368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:55.649236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d546da-f18a-449b-82ee-4c87e6c9f2a5 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:55.654974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:55.656001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:55.656495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:55.656780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] PATH_INFO: `/v3/projects/55ca6c7cc869441081728acca3c82c70` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:55.662875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ca6c7cc869441081728acca3c82c70)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:55.664866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:55.713485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ca6c7cc869441081728acca3c82c70', 'request_id': 'req-34f20ae5-5d1b-420a-a554-c8eea2657440'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.719486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ca6c7cc869441081728acca3c82c70', 'request_id': 'req-34f20ae5-5d1b-420a-a554-c8eea2657440'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.728427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ca6c7cc869441081728acca3c82c70', 'request_id': 'req-34f20ae5-5d1b-420a-a554-c8eea2657440'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.739193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] The token cache is being invalidate because project 55ca6c7cc869441081728acca3c82c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:55.739477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.740119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.741665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1007/2026] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:55 2021] DELETE /identity/v3/projects/55ca6c7cc869441081728acca3c82c70 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:55.746180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:55.757077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b18d7-9c6d-405c-b399-03879c91f09d service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:55.817942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:55.818850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:55.819136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:55.819413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] PATH_INFO: `/v3/users/d8cfa9ca137c481d9f2362fb822e23a9` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:55.820656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8cfa9ca137c481d9f2362fb822e23a9)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:55.822665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:55.869970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8cfa9ca137c481d9f2362fb822e23a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.877226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8cfa9ca137c481d9f2362fb822e23a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.884457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8cfa9ca137c481d9f2362fb822e23a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.884683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8cfa9ca137c481d9f2362fb822e23a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.895736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4fa44a06-912a-443f-9927-82f103e84fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8cfa9ca137c481d9f2362fb822e23a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:55.900112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:55.901510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:55.904841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1020/2027] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:55 2021] DELETE /identity/v3/users/d8cfa9ca137c481d9f2362fb822e23a9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:55.914542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f20ae5-5d1b-420a-a554-c8eea2657440 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:55.988767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:55.988767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:55.989002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:55.989242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] PATH_INFO: `/v3/users/570237ab54a048eba79d5dabbc82e9cf` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:55.990538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570237ab54a048eba79d5dabbc82e9cf)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:55.992594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.045127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570237ab54a048eba79d5dabbc82e9cf'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.062534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570237ab54a048eba79d5dabbc82e9cf'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.069808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570237ab54a048eba79d5dabbc82e9cf'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.083596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570237ab54a048eba79d5dabbc82e9cf'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.084433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570237ab54a048eba79d5dabbc82e9cf'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.091757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1008/2028] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:55 2021] DELETE /identity/v3/users/570237ab54a048eba79d5dabbc82e9cf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:56.096071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.097203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.097203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.114645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:56.115895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.184956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1021/2029] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:56.196485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.198209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.213146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.214705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.234517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b173f57-a4c1-4a80-b9bd-9b104b315721 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.241314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.253508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.253974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.254428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] PATH_INFO: `/v3/projects/2858e27c4efa471b9e1636759551de1c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.256418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2858e27c4efa471b9e1636759551de1c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.260302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.267945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738fc83-51b2-4f94-a28b-45abad5b93d0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.273927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbe1d3-b2a6-4df7-975c-72d6baff644a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.274698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbe1d3-b2a6-4df7-975c-72d6baff644a service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.275737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbe1d3-b2a6-4df7-975c-72d6baff644a service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.276059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbe1d3-b2a6-4df7-975c-72d6baff644a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.287685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbe1d3-b2a6-4df7-975c-72d6baff644a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.289250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbe1d3-b2a6-4df7-975c-72d6baff644a service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.303430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1009/2030] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:04:56.318511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2858e27c4efa471b9e1636759551de1c', 'request_id': 'req-4815d537-9442-462d-93cd-aa4ec47e7d6c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.325654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2858e27c4efa471b9e1636759551de1c', 'request_id': 'req-4815d537-9442-462d-93cd-aa4ec47e7d6c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.335238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2858e27c4efa471b9e1636759551de1c', 'request_id': 'req-4815d537-9442-462d-93cd-aa4ec47e7d6c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.348184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] The token cache is being invalidate because project 2858e27c4efa471b9e1636759551de1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:56.348759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.349515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4815d537-9442-462d-93cd-aa4ec47e7d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.351434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1022/2031] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:56 2021] DELETE /identity/v3/projects/2858e27c4efa471b9e1636759551de1c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:56.357488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.357781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.358062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.378838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:56.380417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.447026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1010/2032] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:56.457618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899125-6983-46c5-af25-01aa23cae537 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.457928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899125-6983-46c5-af25-01aa23cae537 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.458233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899125-6983-46c5-af25-01aa23cae537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.482978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-10899125-6983-46c5-af25-01aa23cae537 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:56.484196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-10899125-6983-46c5-af25-01aa23cae537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.492974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1023/2033] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:04:56.497377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.508888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06f72a-d3fe-473a-b56d-5701a320726e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.514317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.514988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.515256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.515525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.516266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:56.516564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.518832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.531304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1011/2034] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:04:56.535600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899125-6983-46c5-af25-01aa23cae537 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.544805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899125-6983-46c5-af25-01aa23cae537 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.549478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.550133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.550434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.550703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.551414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.553293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.579595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1024/2035] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:56.584920 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.591739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.593885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.598254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e239fe-5725-40e5-886a-86f1250b2da3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.665879 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7019f2e-b1c1-4046-9d3c-8d1bea7265d9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.669980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.670745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.670961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.671078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.671365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.671818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.672100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.672204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.672376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] PATH_INFO: `/v3/projects/e9950e9625284109858b444a485b28cc` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.673591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9950e9625284109858b444a485b28cc)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.674620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.675816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.698596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1012/2036] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:56.700348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.710994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a29e84-d4e8-416e-9062-3a5f83f337db admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.722676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9950e9625284109858b444a485b28cc', 'request_id': 'req-5dce42dd-f370-44a8-949e-c579f043abf9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.728601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9950e9625284109858b444a485b28cc', 'request_id': 'req-5dce42dd-f370-44a8-949e-c579f043abf9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.736519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9950e9625284109858b444a485b28cc', 'request_id': 'req-5dce42dd-f370-44a8-949e-c579f043abf9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.746604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] The token cache is being invalidate because project e9950e9625284109858b444a485b28cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:56.746890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.747533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.749088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1025/2037] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:56 2021] DELETE /identity/v3/projects/e9950e9625284109858b444a485b28cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:04:56.753561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.754955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.765716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.766416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.766722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.766990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.767723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.769884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.779660 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1013/2038] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:56 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:56.784076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.786100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.798192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3739-b24a-4111-a937-ec74fd459b37 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.803483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.804127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.804403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.804676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.805406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.807021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.820617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1014/2039] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:56 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:56.820767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce42dd-f370-44a8-949e-c579f043abf9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.821568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.825296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.826166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.826457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.826727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] PATH_INFO: `/v3/users/1ba79f81ab0645e896614fdd39dacda1` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.827934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba79f81ab0645e896614fdd39dacda1)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.829840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.830791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a5bb3-0538-4b0c-9823-b8bd98152024 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:56.835305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f443853-3a2b-4284-9f2b-f5673ec43818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:56.836400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f443853-3a2b-4284-9f2b-f5673ec43818 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.836682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f443853-3a2b-4284-9f2b-f5673ec43818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.836949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f443853-3a2b-4284-9f2b-f5673ec43818 admin admin] PATH_INFO: `/v3/projects/312fd6d0dc6045ab9ebb9e78dc6ff8ee/users/73aa03053c9b4b11ade289961fa9b689/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.851204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f443853-3a2b-4284-9f2b-f5673ec43818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312fd6d0dc6045ab9ebb9e78dc6ff8ee, user_id=73aa03053c9b4b11ade289961fa9b689, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:56.854050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f443853-3a2b-4284-9f2b-f5673ec43818 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:56.866995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1015/2040] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:56 2021] PUT /identity/v3/projects/312fd6d0dc6045ab9ebb9e78dc6ff8ee/users/73aa03053c9b4b11ade289961fa9b689/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:56.875834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba79f81ab0645e896614fdd39dacda1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.878456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:56.878737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:56.879015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:56.884452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba79f81ab0645e896614fdd39dacda1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.891225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba79f81ab0645e896614fdd39dacda1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.892010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba79f81ab0645e896614fdd39dacda1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.903583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba79f81ab0645e896614fdd39dacda1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:56.905855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] MFA Rules not processed for user `73aa03053c9b4b11ade289961fa9b689`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:56.907106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:56.909374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1026/2041] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:04:56 2021] DELETE /identity/v3/users/1ba79f81ab0645e896614fdd39dacda1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:56.972776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1016/2042] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:56.974502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:56.976088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.041360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb9cee-b474-45e3-aecc-0403f8a0bd29 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.046492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.047335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.047730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.048108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.049045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.051254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.077729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1027/2043] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:56 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:57.082402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.092988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d4c56-f35c-448a-92b6-fd934f51ab83 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.149192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.149871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.150171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.150454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.151158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.153079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.172773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.173586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1017/2044] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:57.175877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.177895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.191367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecef0f-487e-46d6-81a9-8a67c5c86c67 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.193741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a618e-7750-4bbb-8222-761028dee764 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.196998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.198930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.199690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.199983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] PATH_INFO: `/v3/projects/17d5b66d7d9b4794bc818efc34cf2d36` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.200085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.200647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.200929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.201246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.201320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d5b66d7d9b4794bc818efc34cf2d36)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.201908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.203209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.203518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.214063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1018/2045] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:57.219062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.228508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356501d-5746-4169-a4f4-7c6957e76541 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.233538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.234248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.234532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.234799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.235531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.237215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.247637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1019/2046] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:04:57.251886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d5b66d7d9b4794bc818efc34cf2d36', 'request_id': 'req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:57.252159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.260053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d5b66d7d9b4794bc818efc34cf2d36', 'request_id': 'req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:57.264017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef10a6-1407-4df7-9eff-79f973c9aad5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.267246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d5b66d7d9b4794bc818efc34cf2d36', 'request_id': 'req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:57.278693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] The token cache is being invalidate because project 17d5b66d7d9b4794bc818efc34cf2d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:04:57.279207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:57.279886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e37c5d15-6ed3-4ffa-8ebb-f03c7952cfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:04:57.282105 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1028/2047] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:04:57 2021] DELETE /identity/v3/projects/17d5b66d7d9b4794bc818efc34cf2d36 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:57.287919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058cd6-1eb7-4fc8-b336-4fdb2101c533 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.287992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058cd6-1eb7-4fc8-b336-4fdb2101c533 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.288273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02058cd6-1eb7-4fc8-b336-4fdb2101c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.306657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-02058cd6-1eb7-4fc8-b336-4fdb2101c533 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:57.308023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-02058cd6-1eb7-4fc8-b336-4fdb2101c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.323088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc00056-6e52-4e2d-a578-581434fd469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.323974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc00056-6e52-4e2d-a578-581434fd469c admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.324256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc00056-6e52-4e2d-a578-581434fd469c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.324533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc00056-6e52-4e2d-a578-581434fd469c admin admin] PATH_INFO: `/v3/projects/31ac3e96a1b14ac5b786f241b826d658/users/07552f007d78427686b6221a32d4eb18/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.340286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc00056-6e52-4e2d-a578-581434fd469c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ac3e96a1b14ac5b786f241b826d658, user_id=07552f007d78427686b6221a32d4eb18, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.342991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc00056-6e52-4e2d-a578-581434fd469c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.362228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1020/2048] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:57 2021] PUT /identity/v3/projects/31ac3e96a1b14ac5b786f241b826d658/users/07552f007d78427686b6221a32d4eb18/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:57.368566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.368853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.369125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.372850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1029/2049] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:57.381206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.381492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.381768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.396922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] MFA Rules not processed for user `07552f007d78427686b6221a32d4eb18`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:57.398281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.400463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:57.401902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.458205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1030/2050] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:57.461498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1021/2051] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:57.462417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.465355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.466699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.471626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75bb82-1db0-4be1-87dc-f073e6af730c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.476425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.477100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.477383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.477654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.478501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:04:57.478859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.479825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8b253-53cf-42fc-a05a-fc68dbf3e8b0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.480429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.484389 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.485038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.485321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.485599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.486357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.488262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.495020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1031/2052] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:04:57.496174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.507017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b896f-515d-4943-84e3-e7e33ac78bc4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.512214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.512857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.513132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.513397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.514114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.517492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1022/2053] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:04:57.517635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.519146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.546253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1032/2054] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:57.551236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.582314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a91a63-8599-4f77-97b8-b24e6b087d29 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.614382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e4161-6844-479f-9837-8e7fdc7430c6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.619668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.620324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.620605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.620881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.621584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.623524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.638202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.638870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.639151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.639423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.640152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.642016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.643496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1033/2055] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:57.647749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.657343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02fb0-420b-46c6-abc8-7d3e06b9547d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.665432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1023/2056] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:04:57.665595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.665595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.665595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.665595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.665919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.666348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.666491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.675950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e136a6-4c89-4aef-97a9-5550f1bb240e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.680716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1034/2057] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:57.680890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.681292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.681617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.681892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.682248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.682721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.685576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.692553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc95e9-e7bc-4700-bb46-cd1d5719216d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.697614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.698319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.698612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.699024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.702499 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1024/2058] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:57.702599 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.702599 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.703374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.715336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1035/2059] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:57.715552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fdb29-4891-4887-a5c9-b7c709b992c2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.717100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.719703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.720581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.720858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.721152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] PATH_INFO: `/v3/projects/b68bc70b37294a05a52863640f00a0b4/users/966928c5725a4f34995a8ecc19d61950/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.727058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338e74-c067-46a3-9083-65abfb69a440 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.731799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71039ef9-ff58-4f5c-9245-2924efc96eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.732604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71039ef9-ff58-4f5c-9245-2924efc96eef admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.732885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71039ef9-ff58-4f5c-9245-2924efc96eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.733159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71039ef9-ff58-4f5c-9245-2924efc96eef admin admin] PATH_INFO: `/v3/projects/aa1e527f4fdc4cfdb38bf6981bb3ad67/users/bfb5b1222b1d404a901489f5d2edc5eb/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.736085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68bc70b37294a05a52863640f00a0b4, user_id=966928c5725a4f34995a8ecc19d61950, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.738788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.747768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71039ef9-ff58-4f5c-9245-2924efc96eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1e527f4fdc4cfdb38bf6981bb3ad67, user_id=bfb5b1222b1d404a901489f5d2edc5eb, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.750458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71039ef9-ff58-4f5c-9245-2924efc96eef admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.751583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1025/2060] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:57 2021] PUT /identity/v3/projects/b68bc70b37294a05a52863640f00a0b4/users/966928c5725a4f34995a8ecc19d61950/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:57.755652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.763795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1036/2061] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:57 2021] PUT /identity/v3/projects/aa1e527f4fdc4cfdb38bf6981bb3ad67/users/bfb5b1222b1d404a901489f5d2edc5eb/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:57.775674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.775957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.776230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.802203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] MFA Rules not processed for user `bfb5b1222b1d404a901489f5d2edc5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:57.808460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.819561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48fcd1-f88e-4c06-9303-0959422cae2a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.873125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1037/2062] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:57.876602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.877375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.877653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.877922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.878711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.880291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.883831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.885203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.894375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1026/2063] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:04:57.895333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:57.906247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0071c-2e68-4af5-9b5d-57bebdedc876 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.912408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148852bb-5703-4d2c-993e-f26ad192ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.913370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148852bb-5703-4d2c-993e-f26ad192ce38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.913819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148852bb-5703-4d2c-993e-f26ad192ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.914190 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148852bb-5703-4d2c-993e-f26ad192ce38 admin admin] PATH_INFO: `/v3/projects/b68bc70b37294a05a52863640f00a0b4/users/966928c5725a4f34995a8ecc19d61950/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.917002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148852bb-5703-4d2c-993e-f26ad192ce38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68bc70b37294a05a52863640f00a0b4, user_id=966928c5725a4f34995a8ecc19d61950, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:57.920918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148852bb-5703-4d2c-993e-f26ad192ce38 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:57.930991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1027/2064] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:04:57 2021] PUT /identity/v3/projects/b68bc70b37294a05a52863640f00a0b4/users/966928c5725a4f34995a8ecc19d61950/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:04:57.941295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.941435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3f319-b060-4c5a-8462-2867e99889f6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:57.941577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.941849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:57.967721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] MFA Rules not processed for user `966928c5725a4f34995a8ecc19d61950`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:04:57.968900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:57.989890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:57.990867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:57.991333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:57.991663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:58.035716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1028/2065] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:04:57 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:04:58.046040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:58.047462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:58.047590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:58.049027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:58.058423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1038/2066] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:57 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:58.059571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d18b5-c475-406f-988d-8e0bd1a4e816 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:58.063170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:58.063706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:58.063986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:58.064244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:58.073222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:58.074945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:58.084077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1029/2067] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:58 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:04:58.123121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:04:58.131932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954ef41-e70d-43d9-a6e1-54ad877201b4 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:04:58.135618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:04:58.136315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:04:58.136668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:04:58.136997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:04:58.138878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:04:58.200176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:04:58.201880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76062bd1-3e06-4e15-bbc1-73104ffe9d24 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:04:58.211249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1039/2068] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:04:58 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:07.408810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:07.477986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe426-c34b-4d85-a59b-3ed358c27821 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:07.482559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:07.483404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:07.483683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:07.483951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] PATH_INFO: `/v3/users/73aa03053c9b4b11ade289961fa9b689` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:07.485150 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73aa03053c9b4b11ade289961fa9b689)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:07.487613 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:07.534993 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73aa03053c9b4b11ade289961fa9b689'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:07.542308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73aa03053c9b4b11ade289961fa9b689'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:07.549860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73aa03053c9b4b11ade289961fa9b689'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:07.562345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73aa03053c9b4b11ade289961fa9b689'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:07.563072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73aa03053c9b4b11ade289961fa9b689'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:07.569600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1030/2069] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:07 2021] DELETE /identity/v3/users/73aa03053c9b4b11ade289961fa9b689 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:07.574175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:07.574655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:07.574743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:07.591724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:07.593002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:07.663400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1040/2070] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:07.673248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:07.676659 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:07.731280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1e8b-713c-471f-aaab-9faef694a7d1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:07.734899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:07.735527 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:07.735802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:07.736142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:07.744725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:07.746125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:07.755764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1031/2071] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:08.010691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:08.012159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:08.023983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d7eaf-64e6-45cf-8a9c-c4a6fb9c7140 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:08.028569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:08.029423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:08.029707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:08.029981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] PATH_INFO: `/v3/projects/312fd6d0dc6045ab9ebb9e78dc6ff8ee` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:08.031732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312fd6d0dc6045ab9ebb9e78dc6ff8ee)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:08.034381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:08.078598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312fd6d0dc6045ab9ebb9e78dc6ff8ee', 'request_id': 'req-da09e905-f5e8-425a-9dda-e54307aeeef2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.084889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312fd6d0dc6045ab9ebb9e78dc6ff8ee', 'request_id': 'req-da09e905-f5e8-425a-9dda-e54307aeeef2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.092461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312fd6d0dc6045ab9ebb9e78dc6ff8ee', 'request_id': 'req-da09e905-f5e8-425a-9dda-e54307aeeef2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.103089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] The token cache is being invalidate because project 312fd6d0dc6045ab9ebb9e78dc6ff8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:08.103388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.105056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-da09e905-f5e8-425a-9dda-e54307aeeef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.106613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1041/2072] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:08 2021] DELETE /identity/v3/projects/312fd6d0dc6045ab9ebb9e78dc6ff8ee => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:08.110549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:08.120105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9e919-6ae1-49a0-821b-c7ffb1998321 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:08.175796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:08.176663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:08.176942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:08.177216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] PATH_INFO: `/v3/users/07552f007d78427686b6221a32d4eb18` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:08.178452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=07552f007d78427686b6221a32d4eb18)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:08.180397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:08.229109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07552f007d78427686b6221a32d4eb18'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.236477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07552f007d78427686b6221a32d4eb18'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.237148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:08.237484 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:08.237750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:08.243263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07552f007d78427686b6221a32d4eb18'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.257161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] MFA Rules not processed for user `1b47404ef24941829d657acb729f93da`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:08.257323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07552f007d78427686b6221a32d4eb18'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.257843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07552f007d78427686b6221a32d4eb18'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.258603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:08.263677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1032/2073] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:08 2021] DELETE /identity/v3/users/07552f007d78427686b6221a32d4eb18 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:08.314983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1042/2074] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:08.528250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:08.529664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:08.591427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e4abf-60ac-43b6-962e-1206a66347ca admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:08.596009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:08.596836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:08.597191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:08.597441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] PATH_INFO: `/v3/projects/31ac3e96a1b14ac5b786f241b826d658` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:08.598627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ac3e96a1b14ac5b786f241b826d658)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:08.600553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:08.644461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ac3e96a1b14ac5b786f241b826d658', 'request_id': 'req-da5173d2-45dc-450f-a13d-6cccdd54b1f7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.650436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ac3e96a1b14ac5b786f241b826d658', 'request_id': 'req-da5173d2-45dc-450f-a13d-6cccdd54b1f7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.657435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ac3e96a1b14ac5b786f241b826d658', 'request_id': 'req-da5173d2-45dc-450f-a13d-6cccdd54b1f7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.667296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] The token cache is being invalidate because project 31ac3e96a1b14ac5b786f241b826d658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:08.667580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.668194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.669922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1033/2075] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:08 2021] DELETE /identity/v3/projects/31ac3e96a1b14ac5b786f241b826d658 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:08.673656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:08.684306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd63a05-ac8a-4791-940f-7d6a0a9ffdc9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:08.737042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:08.737900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:08.738209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:08.738490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] PATH_INFO: `/v3/users/966928c5725a4f34995a8ecc19d61950` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:08.739681 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966928c5725a4f34995a8ecc19d61950)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:08.741593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:08.784809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966928c5725a4f34995a8ecc19d61950'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.792355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966928c5725a4f34995a8ecc19d61950'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.799732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966928c5725a4f34995a8ecc19d61950'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.800400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966928c5725a4f34995a8ecc19d61950'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.812103 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1704667f-1a9f-48b4-b474-afa2f43665b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966928c5725a4f34995a8ecc19d61950'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:08.822659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1043/2076] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:08 2021] DELETE /identity/v3/users/966928c5725a4f34995a8ecc19d61950 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:09.081097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.082560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:09.097264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5173d2-45dc-450f-a13d-6cccdd54b1f7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.153155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.153995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.154317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.154586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] PATH_INFO: `/v3/projects/b68bc70b37294a05a52863640f00a0b4` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.155753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68bc70b37294a05a52863640f00a0b4)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.157640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.202222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68bc70b37294a05a52863640f00a0b4', 'request_id': 'req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:09.208788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68bc70b37294a05a52863640f00a0b4', 'request_id': 'req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:09.215591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68bc70b37294a05a52863640f00a0b4', 'request_id': 'req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:09.225165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] The token cache is being invalidate because project b68bc70b37294a05a52863640f00a0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:09.225444 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:09.226053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3b9f82de-acf1-4da7-b8b4-353a45ef4a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:09.227581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1034/2077] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:09 2021] DELETE /identity/v3/projects/b68bc70b37294a05a52863640f00a0b4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:09.234219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.234535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.234813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.253605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:09.255642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:09.312965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1044/2078] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:09.322744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.323031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.323306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.343653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:09.344853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:09.352601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1035/2079] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:09.356769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.366353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d61bc-5cce-42b6-9e4e-2fee5334c9e0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.371025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.371667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.371949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.372226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.372966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:05:09.373272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.374903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.387031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1045/2080] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:05:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:05:09.391029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.400770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48e729-acf8-4d96-a428-6c0bd5a7a089 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.405367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.406003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.406328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.406593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.407287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.409685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.434198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1036/2081] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:09 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:05:09.438359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.448100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05382e70-4bce-49f8-a38d-f0f94a888691 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.503032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.503695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.503976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.504255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.505127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.507118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.526539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1046/2082] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:09 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:09.530565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.541202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335acc-83e1-43a1-919b-66fb6d3cb6ba admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.545755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.546440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.546725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.547000 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.547733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.549991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.560011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1037/2083] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:09.563773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.573297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94946600-f00a-406e-bd28-d1248032c06d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.577795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90b89-053d-4617-8065-4a45aa12b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.578470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90b89-053d-4617-8065-4a45aa12b09d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.578746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90b89-053d-4617-8065-4a45aa12b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.579020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90b89-053d-4617-8065-4a45aa12b09d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.580266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c90b89-053d-4617-8065-4a45aa12b09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.581854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c90b89-053d-4617-8065-4a45aa12b09d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.592855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1047/2084] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:09 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:09.595245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.605815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf9ba-f5e7-4228-8268-2aafd0b37825 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.610696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.611645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.611951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.612226 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] PATH_INFO: `/v3/projects/7d0df71913674790ae40c3f524060c57/users/014c5126bdd342e684002236e8853393/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.626500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0df71913674790ae40c3f524060c57, user_id=014c5126bdd342e684002236e8853393, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.629133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.641656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1038/2085] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:09 2021] PUT /identity/v3/projects/7d0df71913674790ae40c3f524060c57/users/014c5126bdd342e684002236e8853393/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:09.647440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c13c-4e83-4bf7-99e8-8129fde44831 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.647798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c13c-4e83-4bf7-99e8-8129fde44831 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.648085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201c13c-4e83-4bf7-99e8-8129fde44831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.667383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b201c13c-4e83-4bf7-99e8-8129fde44831 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:09.668603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b201c13c-4e83-4bf7-99e8-8129fde44831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:09.726424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1048/2086] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:09.736134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:09.737879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:09.790967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24760f0e-01d9-48ae-8183-bc6e0f815e5d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:09.794541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:09.795160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:09.795436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:09.795704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:09.804696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:09.806183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:09.815895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1039/2087] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:10.485849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:10.486679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:10.486953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:10.524744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] MFA Rules not processed for user `014c5126bdd342e684002236e8853393`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:10.526402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:10.598491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1049/2088] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:10 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:10.602826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:10.614250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b0f99-68a0-438e-ba84-67f855213b5a service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:10.620707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:10.621579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:10.621944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:10.622369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:10.623164 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:10.625872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:10.675730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1040/2089] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:10 2021] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:10.679882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:10.691316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2296791-f8be-44e8-b499-41ea0d5b63c4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:10.750648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:10.751336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:10.752144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:10.752422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:10.753166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:10.755229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:10.777395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1050/2090] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:10 2021] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:10.781341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:10.792565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ed36-a2a6-4288-b37a-c89508e6acd5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:10.798179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:10.798976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:10.799258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:10.799655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:10.800387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:10.801984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:10.819707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1041/2091] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:10.823110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:10.836816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69371c9-3d3e-4aa7-a3d2-9c3a04f6aa7d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:10.842807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:10.843782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:10.844135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:10.844478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] PATH_INFO: `/v3/projects/a4e361dbafc149779cf1c90da4a340ca/users/71c08a5d6a614257ae208878d64cd33c/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:10.863205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e361dbafc149779cf1c90da4a340ca, user_id=71c08a5d6a614257ae208878d64cd33c, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:10.866021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:10.882741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1051/2092] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:10 2021] PUT /identity/v3/projects/a4e361dbafc149779cf1c90da4a340ca/users/71c08a5d6a614257ae208878d64cd33c/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:10.887107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:10.899895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611e4d5-0e4d-4813-bff8-fb78b0901bc6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:10.961896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9a68e-2bb6-4ac2-9005-1ab0bae9870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:10.961896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a68e-2bb6-4ac2-9005-1ab0bae9870b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:10.962250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a68e-2bb6-4ac2-9005-1ab0bae9870b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:10.962333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9a68e-2bb6-4ac2-9005-1ab0bae9870b admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:10.963034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9a68e-2bb6-4ac2-9005-1ab0bae9870b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:10.965072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9a68e-2bb6-4ac2-9005-1ab0bae9870b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:10.980558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1042/2093] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:10 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:05:10.982384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:10.994476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808f33d-245a-4897-badb-f9d852e11514 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:11.000989 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:11.002611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:11.003069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:11.003339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] PATH_INFO: `/v3/projects/a4e361dbafc149779cf1c90da4a340ca/users/71c08a5d6a614257ae208878d64cd33c/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:11.005467 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e361dbafc149779cf1c90da4a340ca, user_id=71c08a5d6a614257ae208878d64cd33c, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:11.008158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:11.022550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1052/2094] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:10 2021] PUT /identity/v3/projects/a4e361dbafc149779cf1c90da4a340ca/users/71c08a5d6a614257ae208878d64cd33c/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:11.827274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:11.827848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:11.827848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:11.873642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] MFA Rules not processed for user `71c08a5d6a614257ae208878d64cd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:11.875674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:11.964094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1043/2095] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:11 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:11.975345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:11.977624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:12.036441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2870ee-d26f-4fc3-830e-50a40f03c596 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:12.039966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:12.040605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:12.040886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:12.041162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:12.096032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:12.097503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:12.107226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1053/2096] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:11 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:13.441131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:13.442563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:13.454165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319a4c0-152f-4c1d-b514-596759bd0ab7 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:13.457787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cc375-3068-42b5-aeb0-a0f3761bf307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:13.458446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cc375-3068-42b5-aeb0-a0f3761bf307 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:13.458723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cc375-3068-42b5-aeb0-a0f3761bf307 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:13.458998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cc375-3068-42b5-aeb0-a0f3761bf307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:13.467947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cc375-3068-42b5-aeb0-a0f3761bf307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:13.469368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cc375-3068-42b5-aeb0-a0f3761bf307 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:13.478948 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1044/2097] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:13 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:13.872189 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:13.873662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:13.941431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac520389-a0c6-43c9-921d-afb8919b6b9f service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:13.946023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:13.946916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:13.947198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:13.947475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] PATH_INFO: `/v3/users/c6f889a7f5294815853dd7aea20c703b` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:13.948719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f889a7f5294815853dd7aea20c703b)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:13.950755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.006163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f889a7f5294815853dd7aea20c703b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.015185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f889a7f5294815853dd7aea20c703b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.024069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f889a7f5294815853dd7aea20c703b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.024916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f889a7f5294815853dd7aea20c703b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.040232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f889a7f5294815853dd7aea20c703b'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.046945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1054/2098] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:13 2021] DELETE /identity/v3/users/c6f889a7f5294815853dd7aea20c703b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:05:14.051984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.052276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.052555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.073630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:14.079063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:14.146626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1045/2099] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:14.163675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:14.165766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:14.228110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bb7d1-d068-4075-aeb5-bc89fd80486d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:14.232068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fef7fa-5f84-49a9-b650-0a26b3c797ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:14.232715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef7fa-5f84-49a9-b650-0a26b3c797ef service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.232998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef7fa-5f84-49a9-b650-0a26b3c797ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.233271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fef7fa-5f84-49a9-b650-0a26b3c797ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.243502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fef7fa-5f84-49a9-b650-0a26b3c797ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:14.244945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fef7fa-5f84-49a9-b650-0a26b3c797ef service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.255910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1055/2100] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:14.517704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:14.519221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:14.534649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9110bf-3e89-4464-8168-50d15d850869 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:14.539939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:14.540881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.541251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.541787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] PATH_INFO: `/v3/projects/7fdd7572582c4f72ab236de838a570a6` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.543222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdd7572582c4f72ab236de838a570a6)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:14.545343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.594483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdd7572582c4f72ab236de838a570a6', 'request_id': 'req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.601186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdd7572582c4f72ab236de838a570a6', 'request_id': 'req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.608194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdd7572582c4f72ab236de838a570a6', 'request_id': 'req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.619169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] The token cache is being invalidate because project 7fdd7572582c4f72ab236de838a570a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:14.619449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.620099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c9e88e22-c59e-45b4-9b6d-a4b93b3c46f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:14.621832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1046/2101] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:14 2021] DELETE /identity/v3/projects/7fdd7572582c4f72ab236de838a570a6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:14.627329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.627617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.627889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.644720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:14.646373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:14.707162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1056/2102] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:14.715554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.716007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.716190 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.743223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:14.743223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:14.753064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1047/2103] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:14.757456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:14.769624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c898b-3102-4c0c-a179-c38e6bd5d175 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:14.776178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:14.776954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.777400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.777679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.778478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:05:14.778786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:14.780392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.799493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1057/2104] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:05:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:05:14.801211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:14.814065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb638-09d7-4283-83e3-7e1e1858cb4d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:14.819418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:14.820138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.820488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.820686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.821448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:14.824188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.858183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1048/2105] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:14 2021] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:14.863707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:14.876382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bee5f-2435-48be-a8e6-3b39a8ce4e13 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:14.887295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:14.889774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:14.961308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:14.962246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.962688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.962966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.963695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:14.965680 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.965813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006e7b-cc02-4447-baad-bf284d390d8a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:14.971738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:14.972686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:14.972966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:14.973240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] PATH_INFO: `/v3/users/9417502138f842d7aab2759e0963cab3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:14.974507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9417502138f842d7aab2759e0963cab3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:14.976434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:14.988503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1058/2106] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:14 2021] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:05:14.992426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.004965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a79701-2ada-44a8-9791-2cecf3343a73 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.010864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.011523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.011800 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.012070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.012817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.014430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.028685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1059/2107] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:15.034986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.045683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449fa3-4684-4f15-877e-c955b4b8c19c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.051425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.052268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.052613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.052957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.053769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.055508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.062689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9417502138f842d7aab2759e0963cab3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.066863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1060/2108] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:15.071068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.073293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9417502138f842d7aab2759e0963cab3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.082988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9417502138f842d7aab2759e0963cab3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.084675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331a2e-c8e2-42b9-bde3-06f7b867b65f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.092640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.093549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.093833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.094108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] PATH_INFO: `/v3/projects/c78a2fc93eea4d85bd4d547d653dc2b0/users/dcc76cb4eb2843c9af7299c422400125/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.102554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9417502138f842d7aab2759e0963cab3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.103664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-acd635b4-4f26-4746-b660-4f796d60b012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9417502138f842d7aab2759e0963cab3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.111752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1049/2109] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:14 2021] DELETE /identity/v3/users/9417502138f842d7aab2759e0963cab3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:15.125548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a2fc93eea4d85bd4d547d653dc2b0, user_id=dcc76cb4eb2843c9af7299c422400125, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.129030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.146193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1061/2110] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:15 2021] PUT /identity/v3/projects/c78a2fc93eea4d85bd4d547d653dc2b0/users/dcc76cb4eb2843c9af7299c422400125/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:05:15.151181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.151808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.152087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.171895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:15.173525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:15.245465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1050/2111] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:15.258040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.259971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:15.301909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.303827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:15.316584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f7aec-1db1-4aee-a5db-edea8dd4f320 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.322739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.324228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.324228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.324535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] PATH_INFO: `/v3/projects/f0aee9b9928841cfb7feb62018fc0629` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.326041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0aee9b9928841cfb7feb62018fc0629)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.328177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.333459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dae2e-932a-4898-a474-31fd380a63fd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.337787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da6e46-43c5-498d-ac58-8d847caa0275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.338547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da6e46-43c5-498d-ac58-8d847caa0275 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.338899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da6e46-43c5-498d-ac58-8d847caa0275 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.339387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da6e46-43c5-498d-ac58-8d847caa0275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.350623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da6e46-43c5-498d-ac58-8d847caa0275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.352129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da6e46-43c5-498d-ac58-8d847caa0275 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.367735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1062/2112] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:15.384509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0aee9b9928841cfb7feb62018fc0629', 'request_id': 'req-8671fda2-0a74-494f-82fa-6bdcc54da4ff'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.392759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0aee9b9928841cfb7feb62018fc0629', 'request_id': 'req-8671fda2-0a74-494f-82fa-6bdcc54da4ff'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.403420 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0aee9b9928841cfb7feb62018fc0629', 'request_id': 'req-8671fda2-0a74-494f-82fa-6bdcc54da4ff'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.415266 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] The token cache is being invalidate because project f0aee9b9928841cfb7feb62018fc0629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:15.415657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.416331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8671fda2-0a74-494f-82fa-6bdcc54da4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:15.418079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1051/2113] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:15 2021] DELETE /identity/v3/projects/f0aee9b9928841cfb7feb62018fc0629 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:05:15.423953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.424246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.424524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.443031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:15.444257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:15.515240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1063/2114] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:15.562195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.562641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.562810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.581369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:15.582602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:15.591148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1052/2115] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:15.595127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.605274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfc377-1fa5-4203-823e-8cc3d34da32c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.612121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.612795 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.613074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.613375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.614118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:05:15.614426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.616062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.629294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1064/2116] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:05:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:05:15.633955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.643196 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db066b0-edbb-4fd8-b5ef-f55fa1b74534 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.649137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.649792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.650104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.650412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.651132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.653062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.681173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1053/2117] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:15 2021] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:05:15.686453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.697410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84788d-432b-443b-a7e8-38a3b33cbc87 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.757274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.757992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.758384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.758734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.759622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.762097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.782881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1065/2118] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:15 2021] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:15.787197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.798556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695b822-99cc-4fe8-b68c-0d05f43781bb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.805802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.806730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.807316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.807630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.809643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.811587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.823696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1054/2119] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:15.827533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.838653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced68a2-c3b2-455d-ac90-d2db4486cad5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.843791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6c865-c924-4d4b-98ee-40324afe4578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.844473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6c865-c924-4d4b-98ee-40324afe4578 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.844751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6c865-c924-4d4b-98ee-40324afe4578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.845082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6c865-c924-4d4b-98ee-40324afe4578 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.845817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6c865-c924-4d4b-98ee-40324afe4578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.847449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6c865-c924-4d4b-98ee-40324afe4578 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.857748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1066/2120] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:15.862448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:15.872336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8759b5-1326-40e3-977c-f4be39b2b351 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:15.877881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:15.879402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.879901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.880392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] PATH_INFO: `/v3/projects/3c8d022ad9f948729c91e72aed09c8cd/users/a40300c1b04e4f3c9e9063c1d0d47a9a/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.897663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8d022ad9f948729c91e72aed09c8cd, user_id=a40300c1b04e4f3c9e9063c1d0d47a9a, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:15.900331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:15.914934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1055/2121] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:15 2021] PUT /identity/v3/projects/3c8d022ad9f948729c91e72aed09c8cd/users/a40300c1b04e4f3c9e9063c1d0d47a9a/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:05:15.920655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefcfb0-b713-480e-83fa-f40029a60232 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:15.921500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefcfb0-b713-480e-83fa-f40029a60232 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:15.921781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefcfb0-b713-480e-83fa-f40029a60232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:15.943198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ceefcfb0-b713-480e-83fa-f40029a60232 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:15.944947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ceefcfb0-b713-480e-83fa-f40029a60232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:16.007069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1067/2122] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:16.017338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:16.019302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:16.091736 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b5d92-0301-4506-8beb-6f7f8cd80b82 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:16.095915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:16.096802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:16.096924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:16.097228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:16.109209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:16.111181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:16.121367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1056/2123] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:22.101788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.101788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.101788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.150903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] MFA Rules not processed for user `dcc76cb4eb2843c9af7299c422400125`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:22.152170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:22.255005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1068/2124] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:22.260458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.262072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:22.280522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62957b3d-487c-4631-bf51-1229b8998560 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.285781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.286602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.286840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.287069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.288220 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.291716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.328493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1057/2125] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:22 2021] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:22.333655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.363645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9c97c-02fb-4a60-a83c-e3e2afdba54f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.456032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.457016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.457516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.457992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.459176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.461645 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.488860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1069/2126] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:22 2021] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:22.493629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.508094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a28d0b-c1e0-482d-a94b-aed886b6c1cb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.518940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.519935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.520752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.521205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.522235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.524384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.550545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1058/2127] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:22.554632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.577504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873934e-e3ea-418d-af72-e185ca3810ed admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.587119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.588042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.588324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.591380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] PATH_INFO: `/v3/projects/4609584d1a7344b49813a80ea3fbc26b/users/1f8391b954b4484c993c0211ea4a8e29/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.620175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4609584d1a7344b49813a80ea3fbc26b, user_id=1f8391b954b4484c993c0211ea4a8e29, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.624994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.627267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.627400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:22.646673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1070/2128] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:22 2021] PUT /identity/v3/projects/4609584d1a7344b49813a80ea3fbc26b/users/1f8391b954b4484c993c0211ea4a8e29/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:22.647629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dff45f-3ce2-403d-87a8-08407838fd12 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.652428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.736717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.738350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.740354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.740354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] PATH_INFO: `/v3/users/bfb5b1222b1d404a901489f5d2edc5eb` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.745090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb5b1222b1d404a901489f5d2edc5eb)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.751794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.784490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9b6a0-289a-415f-8551-33b8822f2f79 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.793288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.794382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.794890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.795378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.804943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.806936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.819503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1071/2129] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:22.824173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:22.837784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0542889-e015-4716-9b56-3f9713207969 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:22.845851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb5b1222b1d404a901489f5d2edc5eb'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:22.847303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edfa5e-5a8d-40dc-ad64-af929ee112e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:22.849317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfa5e-5a8d-40dc-ad64-af929ee112e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.850233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfa5e-5a8d-40dc-ad64-af929ee112e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.850908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfa5e-5a8d-40dc-ad64-af929ee112e2 admin admin] PATH_INFO: `/v3/projects/4609584d1a7344b49813a80ea3fbc26b/users/1f8391b954b4484c993c0211ea4a8e29/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:22.853920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edfa5e-5a8d-40dc-ad64-af929ee112e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4609584d1a7344b49813a80ea3fbc26b, user_id=1f8391b954b4484c993c0211ea4a8e29, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:22.857261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb5b1222b1d404a901489f5d2edc5eb'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:22.859099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edfa5e-5a8d-40dc-ad64-af929ee112e2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:22.879754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1072/2130] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:22 2021] PUT /identity/v3/projects/4609584d1a7344b49813a80ea3fbc26b/users/1f8391b954b4484c993c0211ea4a8e29/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:22.903855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb5b1222b1d404a901489f5d2edc5eb'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:22.950676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb5b1222b1d404a901489f5d2edc5eb'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:22.954136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb5b1222b1d404a901489f5d2edc5eb'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:22.967388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1059/2131] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:22 2021] DELETE /identity/v3/users/bfb5b1222b1d404a901489f5d2edc5eb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:05:22.972237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad3c6-0a38-41b8-aef4-2ed44f7c93d5 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:22.972814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad3c6-0a38-41b8-aef4-2ed44f7c93d5 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:22.973296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad3c6-0a38-41b8-aef4-2ed44f7c93d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:23.014585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a5aad3c6-0a38-41b8-aef4-2ed44f7c93d5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:23.022651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a5aad3c6-0a38-41b8-aef4-2ed44f7c93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:23.205250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1073/2132] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:23.257282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:23.259217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:23.355358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638539c-49be-4b15-9a80-ad820364f6e8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:23.359111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58121b11-7886-4055-af39-543cc884af4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:23.360494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58121b11-7886-4055-af39-543cc884af4c service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:23.361219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58121b11-7886-4055-af39-543cc884af4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:23.361913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58121b11-7886-4055-af39-543cc884af4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:23.362367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:23.362672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:23.362949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:23.378405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58121b11-7886-4055-af39-543cc884af4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:23.380746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58121b11-7886-4055-af39-543cc884af4c service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:23.395747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1060/2133] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:23.442546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] MFA Rules not processed for user `a40300c1b04e4f3c9e9063c1d0d47a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:23.443861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:23.565368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1074/2134] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:23 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:23.576030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:23.576400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:23.576798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:23.606183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] MFA Rules not processed for user `a40300c1b04e4f3c9e9063c1d0d47a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:23.612228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:23.634069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1061/2135] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:23 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:23.646709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:23.648624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:23.855219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde7e9f-ad3f-4d0d-9d9b-e78c38ce6aa1 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:23.871793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910cbea-0f7f-4d6b-ab5f-7eb65fe47026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:23.872471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910cbea-0f7f-4d6b-ab5f-7eb65fe47026 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:23.872747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910cbea-0f7f-4d6b-ab5f-7eb65fe47026 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:23.873014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910cbea-0f7f-4d6b-ab5f-7eb65fe47026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:23.894942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910cbea-0f7f-4d6b-ab5f-7eb65fe47026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:23.896830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910cbea-0f7f-4d6b-ab5f-7eb65fe47026 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:23.927703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1075/2136] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:23 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:24.964817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:24.987035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:25.024879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569f535-0c2e-4ae8-9cdb-0839159ce3f9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:25.031231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:25.032201 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:25.032970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:25.033355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] PATH_INFO: `/v3/projects/aa1e527f4fdc4cfdb38bf6981bb3ad67` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:25.043690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1e527f4fdc4cfdb38bf6981bb3ad67)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:25.048590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:25.198808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1e527f4fdc4cfdb38bf6981bb3ad67', 'request_id': 'req-e4a49872-4097-4953-90ab-2f4efc06f7a2'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:25.218265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1e527f4fdc4cfdb38bf6981bb3ad67', 'request_id': 'req-e4a49872-4097-4953-90ab-2f4efc06f7a2'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:25.233934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1e527f4fdc4cfdb38bf6981bb3ad67', 'request_id': 'req-e4a49872-4097-4953-90ab-2f4efc06f7a2'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:25.266324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] The token cache is being invalidate because project aa1e527f4fdc4cfdb38bf6981bb3ad67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:25.267663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:25.268557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e4a49872-4097-4953-90ab-2f4efc06f7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:25.276656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1062/2137] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:24 2021] DELETE /identity/v3/projects/aa1e527f4fdc4cfdb38bf6981bb3ad67 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:25.277674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:25.278255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:25.278255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:25.336166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:25.338069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:25.509528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1076/2138] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:25.518347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:25.519280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:25.519627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:25.602043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:25.603719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:25.662341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:25.663285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1063/2139] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:25.676289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44265f6e-99d7-4532-bd4c-bbe6ab996112 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:25.702970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:25.704479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:25.705019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:25.705459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:25.706392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:05:25.710601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:25.716043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:25.760384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1077/2140] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:05:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:05:25.764585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:25.805399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3acfb-7f60-40d6-9665-fe58f1e688f2 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:25.831770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:25.833879 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:25.835039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:25.835039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:25.839249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:25.845039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:25.943451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1064/2141] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:25 2021] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:05:25.947443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:25.973372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ca02-da07-4c15-8ca3-010783b6ab2f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:26.141705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:26.142441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:26.142724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:26.157872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:26.159739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:26.161755 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:26.262212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:26.262800 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1078/2142] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:25 2021] POST /identity/v3/users => generated 284 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:05:26.279368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bba6b5-7b65-4c2c-b97a-4bbdfd6db6fc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:26.304026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:26.304808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:26.305184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:26.305548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:26.306582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:26.312373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:26.355526 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1065/2143] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:26 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:26.362878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:26.384121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528493-b10e-4a6c-91b7-cfe79b2748f3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:26.399164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a976fc-4a40-4c01-a83f-f27d5c8abc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:26.399776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a976fc-4a40-4c01-a83f-f27d5c8abc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:26.399972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a976fc-4a40-4c01-a83f-f27d5c8abc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:26.400538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a976fc-4a40-4c01-a83f-f27d5c8abc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:26.401993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a976fc-4a40-4c01-a83f-f27d5c8abc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:26.413727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a976fc-4a40-4c01-a83f-f27d5c8abc7f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:26.439790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1079/2144] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:26 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:26.443223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:26.455957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade142e2-1640-4ade-a2b0-22702db5bce8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:26.469957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bfd7e-06d3-481a-a7ec-4860ff94968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:26.470927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bfd7e-06d3-481a-a7ec-4860ff94968f admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:26.471209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bfd7e-06d3-481a-a7ec-4860ff94968f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:26.471484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bfd7e-06d3-481a-a7ec-4860ff94968f admin admin] PATH_INFO: `/v3/projects/e2df868ffbdc4bcda6c6da18d9b253fb/users/c7c992c20e424d4f85e839a581d2b2e9/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:26.509354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bfd7e-06d3-481a-a7ec-4860ff94968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2df868ffbdc4bcda6c6da18d9b253fb, user_id=c7c992c20e424d4f85e839a581d2b2e9, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:26.514942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bfd7e-06d3-481a-a7ec-4860ff94968f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:26.548007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1066/2145] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:26 2021] PUT /identity/v3/projects/e2df868ffbdc4bcda6c6da18d9b253fb/users/c7c992c20e424d4f85e839a581d2b2e9/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:26.560065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:26.560678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:26.561307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:26.629422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] MFA Rules not processed for user `c7c992c20e424d4f85e839a581d2b2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:26.646505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:26.718708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d18f35-f332-4d33-9319-e794aa18f879 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:26.720058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d18f35-f332-4d33-9319-e794aa18f879 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:26.720615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d18f35-f332-4d33-9319-e794aa18f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:26.786316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b3d18f35-f332-4d33-9319-e794aa18f879 None None] MFA Rules not processed for user `a40300c1b04e4f3c9e9063c1d0d47a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:26.788101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b3d18f35-f332-4d33-9319-e794aa18f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:26.886562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1080/2146] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:26 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:26.905396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:26.907771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:26.978715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1067/2147] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:26 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:27.035424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfcbf0-07e2-444f-8a97-747032d5bc18 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:27.042882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:27.043966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:27.044429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:27.044877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:27.056545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:27.059233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:27.072461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1081/2148] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:26 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:05:28.299917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f8cf-9a17-4bdc-9543-e673a752c471 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:28.300438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f8cf-9a17-4bdc-9543-e673a752c471 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:28.300646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f8cf-9a17-4bdc-9543-e673a752c471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:28.350071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c6c0f8cf-9a17-4bdc-9543-e673a752c471 None None] MFA Rules not processed for user `1b47404ef24941829d657acb729f93da`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:28.351600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c6c0f8cf-9a17-4bdc-9543-e673a752c471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:28.604087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1068/2149] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:34.782612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:34.784676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:34.879178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2ae60-75ea-4698-8a49-45b06c553766 service glance] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:34.885603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:34.887614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:34.888373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:34.888876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] PATH_INFO: `/v3/users/014c5126bdd342e684002236e8853393` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:34.891300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=014c5126bdd342e684002236e8853393)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:34.893604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:34.965113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014c5126bdd342e684002236e8853393'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:34.977010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014c5126bdd342e684002236e8853393'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:34.987148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014c5126bdd342e684002236e8853393'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:34.988180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014c5126bdd342e684002236e8853393'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.002727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014c5126bdd342e684002236e8853393'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.010228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1082/2150] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:34 2021] DELETE /identity/v3/users/014c5126bdd342e684002236e8853393 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:35.243234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:35.243805 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:35.243983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:35.313037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] MFA Rules not processed for user `1f8391b954b4484c993c0211ea4a8e29`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:35.314328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:35.408073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1069/2151] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:35 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:35.566090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:35.569491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:35.644416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea4b93-1013-44e7-9224-b1e8fd1ff4ca admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:35.649762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:35.650804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:35.651081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:35.651353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] PATH_INFO: `/v3/projects/7d0df71913674790ae40c3f524060c57` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:35.652558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0df71913674790ae40c3f524060c57)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:35.654633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:35.720720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0df71913674790ae40c3f524060c57', 'request_id': 'req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.729282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0df71913674790ae40c3f524060c57', 'request_id': 'req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.741099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0df71913674790ae40c3f524060c57', 'request_id': 'req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.759525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] The token cache is being invalidate because project 7d0df71913674790ae40c3f524060c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:35.760097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.766219 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:35.768556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1083/2152] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:35 2021] DELETE /identity/v3/projects/7d0df71913674790ae40c3f524060c57 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:35.772583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:35.801321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b7880-fde9-41bc-a1f0-39639c9483ae None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:35.903147 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:35.904162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:35.904677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:35.905004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] PATH_INFO: `/v3/users/71c08a5d6a614257ae208878d64cd33c` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:35.906858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c08a5d6a614257ae208878d64cd33c)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:35.909306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:36.016080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c08a5d6a614257ae208878d64cd33c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.043233 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c08a5d6a614257ae208878d64cd33c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.056848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c08a5d6a614257ae208878d64cd33c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.089949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c08a5d6a614257ae208878d64cd33c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.091008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a75c6c18-969f-4278-946a-dd84befd623b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c08a5d6a614257ae208878d64cd33c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.119840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1070/2153] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:05:35 2021] DELETE /identity/v3/users/71c08a5d6a614257ae208878d64cd33c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:36.460070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:36.461570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:36.481056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654091-35f2-4e17-b6e3-d39c9c61b1ff admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:36.593060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:36.594369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:36.594760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:36.595141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] PATH_INFO: `/v3/projects/a4e361dbafc149779cf1c90da4a340ca` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:36.596696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e361dbafc149779cf1c90da4a340ca)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:36.605954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:36.679420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e361dbafc149779cf1c90da4a340ca', 'request_id': 'req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.688114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e361dbafc149779cf1c90da4a340ca', 'request_id': 'req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.700875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e361dbafc149779cf1c90da4a340ca', 'request_id': 'req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.717363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] The token cache is being invalidate because project a4e361dbafc149779cf1c90da4a340ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:05:36.717550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.718368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-882f5a3e-bc2d-4d8f-91d5-32c3afc8e4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:05:36.721192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1084/2154] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:05:36 2021] DELETE /identity/v3/projects/a4e361dbafc149779cf1c90da4a340ca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:05:36.726467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:36.726986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:36.727105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:36.752723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:36.754327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:36.849691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1071/2155] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:36.857804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:36.858083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:36.858382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:36.884690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:36.886390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:36.898033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1085/2156] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:36.902773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:36.917124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd96ae-7d33-4b81-8100-74d229f3a572 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:36.924885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:36.926999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:36.927685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:36.928129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:36.929115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:05:36.929424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:36.931387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:36.950007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1072/2157] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:05:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:05:36.951238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:36.963630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87933-60e5-4b5e-b0e1-ffe9062bc57e None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:36.971238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:36.971891 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:36.972255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:36.972602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:36.973541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:36.975629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:37.013767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1086/2158] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:05:36 2021] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:05:37.015025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:37.028096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922722c-8f26-401c-a9d1-c3db6f320ff7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:37.096966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:37.098006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:37.098496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:37.098973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:37.099874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:37.102069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:37.135356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1073/2159] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:05:37 2021] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:05:37.136138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:37.149072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78af6-36fe-442d-b0b2-f20bbde30d03 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:37.155372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:37.156540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:37.157255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:37.157728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:37.158718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:37.161775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:37.192142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1087/2160] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:37 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:37.197670 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:37.216912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb34bbc-0736-4096-a41d-7d5fd3f92c0d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:37.226476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20af2-799a-4272-b446-150b448ab56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:37.227637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20af2-799a-4272-b446-150b448ab56e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:37.228228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20af2-799a-4272-b446-150b448ab56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:37.229393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20af2-799a-4272-b446-150b448ab56e admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:37.230292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20af2-799a-4272-b446-150b448ab56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:37.233099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20af2-799a-4272-b446-150b448ab56e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:37.256502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1074/2161] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:05:37 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:05:37.263464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:37.288425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c63b85-5ed5-434d-a7c0-a546c5bdae84 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:37.297192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:37.298964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:37.299626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:37.300252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] PATH_INFO: `/v3/projects/b46bbc0bed7d4240b988cedfca33d196/users/f5db27c491ee4002854039f9e53f52af/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:37.365846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] RBAC: Authorizing `identity:create_grant(project_id=b46bbc0bed7d4240b988cedfca33d196, user_id=f5db27c491ee4002854039f9e53f52af, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:37.376260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:37.415572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1088/2162] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:05:37 2021] PUT /identity/v3/projects/b46bbc0bed7d4240b988cedfca33d196/users/f5db27c491ee4002854039f9e53f52af/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:05:37.421559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69a81a-e18b-44e4-961c-f0f641f118b8 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:37.422060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69a81a-e18b-44e4-961c-f0f641f118b8 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:37.422486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69a81a-e18b-44e4-961c-f0f641f118b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:37.443581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6c69a81a-e18b-44e4-961c-f0f641f118b8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:37.445262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6c69a81a-e18b-44e4-961c-f0f641f118b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:37.547976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1075/2163] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:05:37.561717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:37.564840 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:37.660934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f992-1515-49af-9cb0-1e30611bfada admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:37.669756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:37.672518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:37.673094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:37.673539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:37.686838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:37.689174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:37.700245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1089/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:38.594193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b334a-d1b0-4122-bef0-0c3fc74b4342 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:38.595091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b334a-d1b0-4122-bef0-0c3fc74b4342 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:38.595511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b334a-d1b0-4122-bef0-0c3fc74b4342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:38.625329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-018b334a-d1b0-4122-bef0-0c3fc74b4342 None None] MFA Rules not processed for user `f5db27c491ee4002854039f9e53f52af`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:38.626593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-018b334a-d1b0-4122-bef0-0c3fc74b4342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:38.699281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1076/2165] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:38 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:38.710308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:38.711925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:38.773679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca970c34-3158-4eb2-adae-6153aa73ea0a service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:38.777422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:38.778166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:38.778455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:38.778725 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:38.791886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:38.793490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:38.807787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1090/2166] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:38 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:40.176888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2792a3-2a2d-4286-80f7-dbe34b54d57b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:40.177418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2792a3-2a2d-4286-80f7-dbe34b54d57b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:40.177418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2792a3-2a2d-4286-80f7-dbe34b54d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:40.196366 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-aa2792a3-2a2d-4286-80f7-dbe34b54d57b None None] MFA Rules not processed for user `f5db27c491ee4002854039f9e53f52af`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:40.197612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-aa2792a3-2a2d-4286-80f7-dbe34b54d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:40.205178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1077/2167] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:40 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:44.298793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:44.300213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:44.356784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82791d0-fd27-4dc8-8cdf-c5642bc12116 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:44.360540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:44.361184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:44.361458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:44.361730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:44.363568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:44.423376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:44.424801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:44.433705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1091/2168] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:05:44 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:05:44.591225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bbb9f-a2e2-4c34-a985-dc24a01e4624 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:44.591672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bbb9f-a2e2-4c34-a985-dc24a01e4624 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:44.591757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bbb9f-a2e2-4c34-a985-dc24a01e4624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:44.609093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-856bbb9f-a2e2-4c34-a985-dc24a01e4624 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:44.610369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-856bbb9f-a2e2-4c34-a985-dc24a01e4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:44.663814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1078/2169] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:05:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:44.705930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:44.707427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:44.774877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff56be-7629-4eea-b0ff-a1ac7161b021 service glance] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:44.780520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f588d8-1ca6-4c0b-aca2-beea3ce403da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:44.781165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f588d8-1ca6-4c0b-aca2-beea3ce403da service swift] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:44.781448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f588d8-1ca6-4c0b-aca2-beea3ce403da service swift] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:44.781722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f588d8-1ca6-4c0b-aca2-beea3ce403da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:44.790225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f588d8-1ca6-4c0b-aca2-beea3ce403da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:44.791813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f588d8-1ca6-4c0b-aca2-beea3ce403da service swift] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:44.800178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1092/2170] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:05:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:05:55.661514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:55.662559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:55.663063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:55.689689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] MFA Rules not processed for user `dcc76cb4eb2843c9af7299c422400125`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:55.692129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:55.708894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1079/2171] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:05:55 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:57.924592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:57.925227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:57.925227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:57.948822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:05:57.950427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:05:57.967511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1093/2172] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:05:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:05:57.988136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:05:58.001968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9221da-d86d-4c09-9f03-874f35724761 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:05:58.025352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901b7fe-29e8-44a5-b3cd-78e7ae3bb785 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:05:58.025352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b7fe-29e8-44a5-b3cd-78e7ae3bb785 service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:05:58.025352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b7fe-29e8-44a5-b3cd-78e7ae3bb785 service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:05:58.025352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901b7fe-29e8-44a5-b3cd-78e7ae3bb785 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:05:58.032569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901b7fe-29e8-44a5-b3cd-78e7ae3bb785 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:05:58.034533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901b7fe-29e8-44a5-b3cd-78e7ae3bb785 service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:05:58.044483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1080/2173] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:05:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:06:18.046847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:18.048441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:18.060956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:18.061486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:18.061588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:18.066280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bcace-1c97-448a-aabe-f41207beb29a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:18.074944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:18.075799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:18.076150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:18.076464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] PATH_INFO: `/v3/users/c7c992c20e424d4f85e839a581d2b2e9` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:18.077925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c992c20e424d4f85e839a581d2b2e9)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:18.081634 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:18.087567 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:18.089107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:18.098271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1081/2174] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:06:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:06:18.113311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:18.129754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9a9e-40cd-4034-847c-205b5236203c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:18.136688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278190-0d37-4cac-a95d-369eaee7615e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:18.137662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278190-0d37-4cac-a95d-369eaee7615e service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:18.138273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278190-0d37-4cac-a95d-369eaee7615e service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:18.138794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278190-0d37-4cac-a95d-369eaee7615e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:18.147676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c992c20e424d4f85e839a581d2b2e9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:18.150215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278190-0d37-4cac-a95d-369eaee7615e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:18.152605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278190-0d37-4cac-a95d-369eaee7615e service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:18.156668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c992c20e424d4f85e839a581d2b2e9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:18.164028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1082/2175] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:06:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:06:18.175147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c992c20e424d4f85e839a581d2b2e9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:18.175147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c992c20e424d4f85e839a581d2b2e9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:18.193655 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c992c20e424d4f85e839a581d2b2e9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:18.205009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1094/2176] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:06:18 2021] DELETE /identity/v3/users/c7c992c20e424d4f85e839a581d2b2e9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:06:18.209416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:18.209696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:18.210170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:18.230701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:18.232123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:18.353937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1083/2177] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:18.364926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:18.366782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:18.486968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a99a38-2897-4398-b6be-c5d34c1d7f3b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:18.508505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a7bf5-290e-4099-a645-261b252f4748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:18.509510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a7bf5-290e-4099-a645-261b252f4748 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:18.510833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a7bf5-290e-4099-a645-261b252f4748 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:18.511555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a7bf5-290e-4099-a645-261b252f4748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:18.531584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a7bf5-290e-4099-a645-261b252f4748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:18.533267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a7bf5-290e-4099-a645-261b252f4748 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:18.569695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1095/2178] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:06:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:06:19.333488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:19.335066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:19.352688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb14fb3-1591-4b11-a53e-dc101c02fdb5 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:19.360619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:19.362169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:19.362558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:19.362957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] PATH_INFO: `/v3/projects/e2df868ffbdc4bcda6c6da18d9b253fb` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:19.365508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2df868ffbdc4bcda6c6da18d9b253fb)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:19.371752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:19.458169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2df868ffbdc4bcda6c6da18d9b253fb', 'request_id': 'req-72e76e24-c65b-4a48-b5ab-4a336704969b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:19.466007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2df868ffbdc4bcda6c6da18d9b253fb', 'request_id': 'req-72e76e24-c65b-4a48-b5ab-4a336704969b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:19.475555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2df868ffbdc4bcda6c6da18d9b253fb', 'request_id': 'req-72e76e24-c65b-4a48-b5ab-4a336704969b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:19.494690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] The token cache is being invalidate because project e2df868ffbdc4bcda6c6da18d9b253fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:06:19.494986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:19.495870 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-72e76e24-c65b-4a48-b5ab-4a336704969b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:06:19.497983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1084/2179] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:06:19 2021] DELETE /identity/v3/projects/e2df868ffbdc4bcda6c6da18d9b253fb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:06:19.504302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:19.504917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:19.505245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:19.533183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:19.535399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:19.614132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1096/2180] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:19.624691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:19.626174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:19.627341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:19.652388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:19.653605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:19.665755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1085/2181] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:19.667460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:19.680360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e596ea-2a7b-43cf-9016-b9e42d388614 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:19.698639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:19.699485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:19.699872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:19.700207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:19.702872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:06:19.703281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:19.705626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:19.730627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1097/2182] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:06:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:06:19.735182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:19.747041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4fb74-4645-411f-bdd1-2326c6f6e260 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:19.753669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:19.754487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:19.754821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:19.755129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:19.758549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:19.759029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:19.814175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1086/2183] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:06:19 2021] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:06:19.818425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:19.829443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a36cc-bf59-4b3a-8398-72551c8620f0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:19.936089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:19.937099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:19.937381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:19.937660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:19.938413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:19.940327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:19.974944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:19.976482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1098/2184] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:06:19 2021] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:06:19.987730 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfd3ec-5a51-438e-b269-25ad9cb65b0c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:19.999138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:19.999817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:20.000107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:20.000374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:20.001692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:20.003327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:20.024467 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1087/2185] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:06:19 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:06:20.026192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:20.037677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bff7f-918f-48dc-98d7-9fdeec51aacc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:20.042978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f05f-bd1f-4d3f-9f8e-6b417d6b5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:20.043714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f05f-bd1f-4d3f-9f8e-6b417d6b5410 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:20.044001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f05f-bd1f-4d3f-9f8e-6b417d6b5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:20.045311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f05f-bd1f-4d3f-9f8e-6b417d6b5410 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:20.046263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f05f-bd1f-4d3f-9f8e-6b417d6b5410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:20.048119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f05f-bd1f-4d3f-9f8e-6b417d6b5410 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:20.070309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1099/2186] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:06:20 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:06:20.071605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:20.085693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335dffb-7f3b-4474-95e0-9f404d969c58 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:20.094178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:20.095840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:20.096186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:20.096503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] PATH_INFO: `/v3/projects/f99f95481db4457bb0ccf066963bc5a3/users/1fc9c3ef4df5402fa8c33cf847874d14/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:20.119057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99f95481db4457bb0ccf066963bc5a3, user_id=1fc9c3ef4df5402fa8c33cf847874d14, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:20.122279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:20.154283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1088/2187] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:06:20 2021] PUT /identity/v3/projects/f99f95481db4457bb0ccf066963bc5a3/users/1fc9c3ef4df5402fa8c33cf847874d14/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:06:20.164958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073297e2-ff8a-4a64-803a-a5ea7840ba6c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:20.165255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073297e2-ff8a-4a64-803a-a5ea7840ba6c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:20.165846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073297e2-ff8a-4a64-803a-a5ea7840ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:20.213939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-073297e2-ff8a-4a64-803a-a5ea7840ba6c None None] MFA Rules not processed for user `1fc9c3ef4df5402fa8c33cf847874d14`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:20.216201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-073297e2-ff8a-4a64-803a-a5ea7840ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:20.310491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1100/2188] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:20 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:20.325025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:20.326912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:20.395846 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2908e-0f57-4374-aab9-23022cda9f7b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:20.400033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a83aa-61c4-4267-bfb6-fbedd4de91c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:20.400681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a83aa-61c4-4267-bfb6-fbedd4de91c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:20.400961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a83aa-61c4-4267-bfb6-fbedd4de91c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:20.401238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a83aa-61c4-4267-bfb6-fbedd4de91c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:20.413332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a83aa-61c4-4267-bfb6-fbedd4de91c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:20.414822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a83aa-61c4-4267-bfb6-fbedd4de91c7 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:20.424935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1089/2189] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:06:20 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:06:28.275208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c592130-1ad3-4300-85bc-4f5da392331b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:28.276747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c592130-1ad3-4300-85bc-4f5da392331b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:28.277304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c592130-1ad3-4300-85bc-4f5da392331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:28.298602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7c592130-1ad3-4300-85bc-4f5da392331b None None] MFA Rules not processed for user `f5db27c491ee4002854039f9e53f52af`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:28.300159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7c592130-1ad3-4300-85bc-4f5da392331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:28.410208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1101/2190] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:32.263603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49a87-e0da-4fa2-b5d5-0e2e5e25e8b9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:32.264503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49a87-e0da-4fa2-b5d5-0e2e5e25e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:32.264927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca49a87-e0da-4fa2-b5d5-0e2e5e25e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:32.301513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6ca49a87-e0da-4fa2-b5d5-0e2e5e25e8b9 None None] MFA Rules not processed for user `1b47404ef24941829d657acb729f93da`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:32.302934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6ca49a87-e0da-4fa2-b5d5-0e2e5e25e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:32.382531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1090/2191] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:32 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:06:40.311746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f26dc-9f50-446b-b2a2-8e84d9b34d41 None None] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:40.312829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f26dc-9f50-446b-b2a2-8e84d9b34d41 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:40.312829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f26dc-9f50-446b-b2a2-8e84d9b34d41 None None] PATH_INFO: `/` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:40.314798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1102/2192] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 13:06:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 15 13:06:40.321897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ab6f3-2d34-4af6-9b96-8e3e2a8880a1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:40.322893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ab6f3-2d34-4af6-9b96-8e3e2a8880a1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:40.323231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ab6f3-2d34-4af6-9b96-8e3e2a8880a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:40.342361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-592ab6f3-2d34-4af6-9b96-8e3e2a8880a1 None None] MFA Rules not processed for user `6b2623b20f16432d986a95fc400d52b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:40.344124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-592ab6f3-2d34-4af6-9b96-8e3e2a8880a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:40.460423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1091/2193] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 13:06:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:40.474956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f26dc-9f50-446b-b2a2-8e84d9b34d41 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:40.477083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-0b3f26dc-9f50-446b-b2a2-8e84d9b34d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:40.547001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f26dc-9f50-446b-b2a2-8e84d9b34d41 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:40.551842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09898cc-482b-472f-8a94-d07338b73275 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:40.552592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09898cc-482b-472f-8a94-d07338b73275 service glance] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:40.552882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09898cc-482b-472f-8a94-d07338b73275 service glance] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:40.553210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09898cc-482b-472f-8a94-d07338b73275 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:40.566491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09898cc-482b-472f-8a94-d07338b73275 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:40.568056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09898cc-482b-472f-8a94-d07338b73275 service glance] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:40.580522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1103/2194] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:06:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:06:40.663850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219b61f-cd08-4949-abe7-33255e46a350 None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:40.664139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219b61f-cd08-4949-abe7-33255e46a350 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:40.664419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219b61f-cd08-4949-abe7-33255e46a350 None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:40.666310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1092/2195] 10.222.0.57 () {54 vars in 921 bytes} [Wed Dec 15 13:06:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:06:40.673290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:40.673607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:40.673887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:40.709844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] MFA Rules not processed for user `6300d566628547b48cbe60769799c1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:40.711226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:40.828134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1104/2196] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Dec 15 13:06:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:40.841831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219b61f-cd08-4949-abe7-33255e46a350 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:40.844785 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5219b61f-cd08-4949-abe7-33255e46a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:40.860066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219b61f-cd08-4949-abe7-33255e46a350 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:40.866092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369448f-9527-4100-b989-c80850b70277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:40.867014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369448f-9527-4100-b989-c80850b70277 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:40.867365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369448f-9527-4100-b989-c80850b70277 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:40.867714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369448f-9527-4100-b989-c80850b70277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:40.875800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369448f-9527-4100-b989-c80850b70277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:40.883455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369448f-9527-4100-b989-c80850b70277 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:40.892623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1093/2197] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:06:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:06:47.747647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:47.751024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:47.762974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c41dd-cd9d-4bc2-bbbd-70c1d119b94f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:47.768283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:47.769123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:47.769577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:47.769969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:47.772197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:47.847740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:47.849177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84a33a-8502-4c8f-88ad-b6c4f24e4607 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:47.862328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1105/2198] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:06:47 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:06:52.441800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:52.442380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:52.442720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:52.469850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] MFA Rules not processed for user `047982e41574460caa4bf3b79a9a8370`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:52.471426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:52.586192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1094/2199] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:06:52 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:53.756040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:53.757153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:53.757635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:53.793277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:06:53.794773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:53.915711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1106/2200] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:06:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:06:53.947064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:06:53.949059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:06:54.163195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fae627-61f1-42d5-8c92-5838c8d3f5ce None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:06:54.182355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f71f-5810-4446-bb5b-683a92bd09cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:06:54.184226 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f71f-5810-4446-bb5b-683a92bd09cf service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:06:54.185021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f71f-5810-4446-bb5b-683a92bd09cf service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:06:54.186001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f71f-5810-4446-bb5b-683a92bd09cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:06:54.210435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4f71f-5810-4446-bb5b-683a92bd09cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:06:54.213474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4f71f-5810-4446-bb5b-683a92bd09cf service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:06:54.320292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1095/2201] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:06:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:10.298601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:10.377110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acdf7-58a0-42db-bc4c-0e66aaef208c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:10.381791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:10.382689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:10.382970 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:10.383244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] PATH_INFO: `/v3/users/1fc9c3ef4df5402fa8c33cf847874d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:10.384482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc9c3ef4df5402fa8c33cf847874d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:10.386412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:10.439775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc9c3ef4df5402fa8c33cf847874d14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:10.447909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc9c3ef4df5402fa8c33cf847874d14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:10.455750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc9c3ef4df5402fa8c33cf847874d14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:10.456534 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc9c3ef4df5402fa8c33cf847874d14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:10.468651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc9c3ef4df5402fa8c33cf847874d14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:10.474591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1107/2202] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:07:10 2021] DELETE /identity/v3/users/1fc9c3ef4df5402fa8c33cf847874d14 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:10.479114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:10.479696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:10.479696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:10.520170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:10.521382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:10.595614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1096/2203] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:10.606089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:10.608358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:10.683590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93b96d-e714-43b5-bd46-fd1a5a4bd6cc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:10.688208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:10.688901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:10.689184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:10.689517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:10.703019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:10.706560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:10.728341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1108/2204] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:07:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:07:10.899869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:10.901322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:11.034388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc1f97-29a8-4a03-a488-762091cda3b9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:11.041158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:11.042023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.042275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.042629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.044817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:11.057631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:11.059970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c58593-edf8-4fbe-a258-08af81998b44 service placement] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:11.072720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1097/2205] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:07:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:07:11.426042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:11.427784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:11.443958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102008d-f6f3-4ccc-8738-36dd74bb6a4b service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:11.450962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:11.452072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.452352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.452621 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] PATH_INFO: `/v3/projects/f99f95481db4457bb0ccf066963bc5a3` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.453856 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99f95481db4457bb0ccf066963bc5a3)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:11.456711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:11.522728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99f95481db4457bb0ccf066963bc5a3', 'request_id': 'req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:11.529728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99f95481db4457bb0ccf066963bc5a3', 'request_id': 'req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:11.540495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99f95481db4457bb0ccf066963bc5a3', 'request_id': 'req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:11.552229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] The token cache is being invalidate because project f99f95481db4457bb0ccf066963bc5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:07:11.552514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:11.553217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-473c0bbb-6ef1-463d-9cfc-2a62a18126b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:11.555018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1109/2206] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:07:11 2021] DELETE /identity/v3/projects/f99f95481db4457bb0ccf066963bc5a3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:11.561024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.561549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.561549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.612899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:11.614173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:11.676804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1098/2207] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:11.684913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.685281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.685631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.705323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:11.706682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:11.717227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1110/2208] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:11.721708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:11.732953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285ebf6-e069-4fb7-af31-4b60d0be52a7 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:11.738022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:11.739173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.739173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.739482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.740477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:07:11.741003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:11.743300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:11.757017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1099/2209] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:07:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:07:11.761321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:11.777496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679573-6316-44c7-b1ce-e7e4df74540c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:11.785044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:11.786028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.787722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.788158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.789272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:11.792383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:11.835377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1111/2210] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:07:11 2021] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:07:11.839260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:11.854602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688429f-69d8-4530-a2ea-b88e8d6cbbb1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:11.945598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:11.946333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:11.946618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:11.946895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:11.947629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:11.949576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:11.979181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1100/2211] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:07:11 2021] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:07:11.980829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:11.998854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d4299-e60c-4f9c-9a97-53549c954262 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:12.017686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:12.018435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:12.018734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:12.019169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:12.019923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:12.022377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:12.037577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1112/2212] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:07:11 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:07:12.039035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:12.056615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797d50-0830-48d6-8374-167c0f68f767 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:12.064620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e351-bf6e-41f6-9ccc-f48d965c6b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:12.065899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e351-bf6e-41f6-9ccc-f48d965c6b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:12.066651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e351-bf6e-41f6-9ccc-f48d965c6b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:12.067338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e351-bf6e-41f6-9ccc-f48d965c6b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:12.068752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e351-bf6e-41f6-9ccc-f48d965c6b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:12.071848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e351-bf6e-41f6-9ccc-f48d965c6b36 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:12.096005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1101/2213] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:07:12 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:07:12.099990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:12.112914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754cbe7-14d8-4a7e-a7a3-ab505b7cc65f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:12.117945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:12.118865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:12.119147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:12.119420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] PATH_INFO: `/v3/projects/91d936046d064508ba41edf0024c46e3/users/4d477d0eafb8448296405640b334d715/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:12.137125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d936046d064508ba41edf0024c46e3, user_id=4d477d0eafb8448296405640b334d715, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:12.140523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:12.191312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78369-6275-431c-84fb-2e6585a72132 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:12.191616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78369-6275-431c-84fb-2e6585a72132 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:12.191946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78369-6275-431c-84fb-2e6585a72132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:12.193216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1113/2214] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:07:12 2021] PUT /identity/v3/projects/91d936046d064508ba41edf0024c46e3/users/4d477d0eafb8448296405640b334d715/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:12.232202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-21f78369-6275-431c-84fb-2e6585a72132 None None] MFA Rules not processed for user `4d477d0eafb8448296405640b334d715`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:12.233432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-21f78369-6275-431c-84fb-2e6585a72132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:12.341954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1102/2215] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:07:12.353385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:12.355127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:12.585101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310ef40-7efc-4fa0-879a-91f4e27ad29e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:12.609474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e89c-eb03-4d86-afd3-4b7cb33af49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:12.610831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e89c-eb03-4d86-afd3-4b7cb33af49a service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:12.611338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e89c-eb03-4d86-afd3-4b7cb33af49a service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:12.611800 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e89c-eb03-4d86-afd3-4b7cb33af49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:12.628592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639e89c-eb03-4d86-afd3-4b7cb33af49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:12.631704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639e89c-eb03-4d86-afd3-4b7cb33af49a service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:12.650767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1114/2216] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:07:12 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:07:14.026579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:14.026963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:14.027073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:14.046393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] MFA Rules not processed for user `4d477d0eafb8448296405640b334d715`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:14.047600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:14.055112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1103/2217] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:14 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:22.592215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9b09-45c8-4ecb-b868-0ba933e119b9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:22.592761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9b09-45c8-4ecb-b868-0ba933e119b9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:22.594367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac9b09-45c8-4ecb-b868-0ba933e119b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:22.631608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-10ac9b09-45c8-4ecb-b868-0ba933e119b9 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:22.632996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-10ac9b09-45c8-4ecb-b868-0ba933e119b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:22.696715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1115/2218] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:07:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:22.710322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:22.711710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:22.783562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81993-5646-471e-b1cd-70b463f0e962 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:22.789957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:22.791125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:22.791565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:22.791855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:22.806898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:22.809427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:22.821083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1104/2219] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:32.971272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f62f9-f7c7-43a3-b4b3-37a9f27e05ea None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:32.971841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f62f9-f7c7-43a3-b4b3-37a9f27e05ea None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:32.971973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f62f9-f7c7-43a3-b4b3-37a9f27e05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:33.041028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bb0f62f9-f7c7-43a3-b4b3-37a9f27e05ea None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:33.042344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bb0f62f9-f7c7-43a3-b4b3-37a9f27e05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:33.061335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1116/2220] 10.222.0.57 () {58 vars in 967 bytes} [Wed Dec 15 13:07:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:33.077699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:33.098887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e535fae-7d55-498b-9d8a-efceae506fa8 service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:33.105091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:33.106345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:33.106988 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:33.107541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:33.117822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:33.121852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:33.143658 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1105/2221] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:48.369921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c9ca-c2b6-44d8-b332-2a9efd9b49aa None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:48.370624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c9ca-c2b6-44d8-b332-2a9efd9b49aa None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:48.370624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4c9ca-c2b6-44d8-b332-2a9efd9b49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:48.389054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d3b4c9ca-c2b6-44d8-b332-2a9efd9b49aa None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:48.391498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d3b4c9ca-c2b6-44d8-b332-2a9efd9b49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:48.398134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1117/2222] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:07:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:07:48.413358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:48.424991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ebc78-346c-4741-8b7d-0000743d5317 service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:48.430543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:48.431194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:48.431478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:48.431758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:48.441092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:48.442714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:48.451596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1106/2223] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:48.500944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340d02f-a30e-401b-985a-7cb3ff1dc913 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:48.501437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340d02f-a30e-401b-985a-7cb3ff1dc913 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:48.501923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340d02f-a30e-401b-985a-7cb3ff1dc913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:48.523791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-f340d02f-a30e-401b-985a-7cb3ff1dc913 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:48.525227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f340d02f-a30e-401b-985a-7cb3ff1dc913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:48.540954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1118/2224] 10.222.0.57 () {58 vars in 967 bytes} [Wed Dec 15 13:07:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:48.556819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:48.569587 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed7555-0d3f-40fb-bb7d-b0b72c4d021d service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:48.577911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:48.578597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:48.578906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:48.579182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:48.589137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:48.590784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:48.608283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1107/2225] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:49.118335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013a68-ce60-40b7-b3bd-72e7e62efb13 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:49.118624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013a68-ce60-40b7-b3bd-72e7e62efb13 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:49.118903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b013a68-ce60-40b7-b3bd-72e7e62efb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:49.138686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-3b013a68-ce60-40b7-b3bd-72e7e62efb13 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:49.139888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3b013a68-ce60-40b7-b3bd-72e7e62efb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:49.148616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1119/2226] 10.222.0.57 () {58 vars in 967 bytes} [Wed Dec 15 13:07:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:49.167494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:49.181779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204033-9720-4e5d-8973-80ac86174534 service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:49.196225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:49.196915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:49.197219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:49.197515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:49.206336 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:49.207974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:49.216177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1108/2227] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:07:49.411385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85a95-dd2e-499f-9dc1-6e01f81c2a23 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:49.411385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85a95-dd2e-499f-9dc1-6e01f81c2a23 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:49.411912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85a95-dd2e-499f-9dc1-6e01f81c2a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:49.429320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cae85a95-dd2e-499f-9dc1-6e01f81c2a23 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:49.430573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cae85a95-dd2e-499f-9dc1-6e01f81c2a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:49.438658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1120/2228] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:07:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:49.452528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:49.463323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3761a-8123-476b-8fb5-6c3f5603745f service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:49.468650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:49.469273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:49.469573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:49.469893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:49.477642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:49.479727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:49.487438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1109/2229] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:07:49.808575 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:49.809078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:49.809511 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:49.836485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:49.837470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:49.848295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1121/2230] 10.222.0.57 () {58 vars in 967 bytes} [Wed Dec 15 13:07:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:49.861926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:49.872450 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a968420-92ce-43b3-abc6-448254b8176f service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:49.877701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf1992-0cde-43ab-9712-18686c3fd321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:49.878381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1992-0cde-43ab-9712-18686c3fd321 service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:49.878669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1992-0cde-43ab-9712-18686c3fd321 service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:49.878943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1992-0cde-43ab-9712-18686c3fd321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:49.888136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf1992-0cde-43ab-9712-18686c3fd321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:49.889763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf1992-0cde-43ab-9712-18686c3fd321 service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:49.899027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1110/2231] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:07:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:07:52.933875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:53.010110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3038-dd64-46b1-b9e4-f43bf660a2fe None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:53.015971 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:53.016842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:53.017117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:53.017385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] PATH_INFO: `/v3/users/4d477d0eafb8448296405640b334d715` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:53.018629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d477d0eafb8448296405640b334d715)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:53.020547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:53.064196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d477d0eafb8448296405640b334d715'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.072312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d477d0eafb8448296405640b334d715'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.079392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d477d0eafb8448296405640b334d715'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.080020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d477d0eafb8448296405640b334d715'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.091892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d477d0eafb8448296405640b334d715'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.097780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1122/2232] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:07:52 2021] DELETE /identity/v3/users/4d477d0eafb8448296405640b334d715 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:53.102595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:53.103109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:53.103261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:53.120158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:53.121518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:53.180897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1111/2233] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:53.191349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:53.192746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:53.253984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f078d-85bc-4f33-8d17-e38fa12ed070 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:53.257756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:53.258434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:53.258713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:53.259066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:53.268705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:53.270264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:53.281274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1123/2234] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:07:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:07:53.522111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:53.524232 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:53.539585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5cac8-60c4-4e0c-96c5-fcdc991e6c6e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:53.567574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:53.567574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:53.567574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:53.567574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] PATH_INFO: `/v3/projects/91d936046d064508ba41edf0024c46e3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:53.568379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d936046d064508ba41edf0024c46e3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:53.568379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:53.615054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d936046d064508ba41edf0024c46e3', 'request_id': 'req-d6517a7e-961e-43d8-92ec-5ea40fadc079'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.621695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d936046d064508ba41edf0024c46e3', 'request_id': 'req-d6517a7e-961e-43d8-92ec-5ea40fadc079'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.629252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d936046d064508ba41edf0024c46e3', 'request_id': 'req-d6517a7e-961e-43d8-92ec-5ea40fadc079'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.640902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] The token cache is being invalidate because project 91d936046d064508ba41edf0024c46e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:07:53.641180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.641818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.643406 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1112/2235] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:07:53 2021] DELETE /identity/v3/projects/91d936046d064508ba41edf0024c46e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:53.827326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:53.828828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:53.842097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16a417-3668-4731-96f2-819e25eaedc0 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:53.897838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:53.898789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:53.899014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:53.899293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] PATH_INFO: `/v3/users/f5db27c491ee4002854039f9e53f52af` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:53.900545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5db27c491ee4002854039f9e53f52af)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:53.902590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:53.949945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5db27c491ee4002854039f9e53f52af'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.957692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5db27c491ee4002854039f9e53f52af'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.964330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5db27c491ee4002854039f9e53f52af'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.964947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5db27c491ee4002854039f9e53f52af'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.975951 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2212d16d-e282-44cd-a4c8-259feecfda81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5db27c491ee4002854039f9e53f52af'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:53.982263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1124/2236] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:07:53 2021] DELETE /identity/v3/users/f5db27c491ee4002854039f9e53f52af => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:54.162497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.163937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:54.179135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6517a7e-961e-43d8-92ec-5ea40fadc079 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.237711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.238596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.238874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.239144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] PATH_INFO: `/v3/projects/b46bbc0bed7d4240b988cedfca33d196` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.240355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b46bbc0bed7d4240b988cedfca33d196)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.242289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.287410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46bbc0bed7d4240b988cedfca33d196', 'request_id': 'req-8563f657-f485-4e81-849d-d8467a2555ac'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:54.293959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46bbc0bed7d4240b988cedfca33d196', 'request_id': 'req-8563f657-f485-4e81-849d-d8467a2555ac'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:54.301560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46bbc0bed7d4240b988cedfca33d196', 'request_id': 'req-8563f657-f485-4e81-849d-d8467a2555ac'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:54.312829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] The token cache is being invalidate because project b46bbc0bed7d4240b988cedfca33d196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:07:54.313113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:54.313739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8563f657-f485-4e81-849d-d8467a2555ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:54.315303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1113/2237] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:07:54 2021] DELETE /identity/v3/projects/b46bbc0bed7d4240b988cedfca33d196 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:54.323691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.323996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.324259 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.343119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:54.344324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:54.409007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1125/2238] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:54.416913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.417228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.417510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.436858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:54.438058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:54.446356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1114/2239] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:54.451765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.462242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d5261-644c-48cd-99d1-a009565b6e0f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.467836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.468473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.468748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.469013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.469742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:07:54.470039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.471647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.482732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1126/2240] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:07:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:07:54.488084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.497763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0c9e8-76cf-4ab9-bd48-b120aab5b6ea None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.501937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.502617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.502895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.503167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.503899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.505801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.533300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1115/2241] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:07:54 2021] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:07:54.537694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.548482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb29fd4-1418-4aaa-9f00-8cba04466bd9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.611092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.611860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.612211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.612559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.613358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.615392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.642572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1127/2242] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:07:54 2021] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:07:54.643979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.655469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b6851-3fb2-42fa-a975-3e82e54d9465 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.662312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.662960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.663242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.663529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.664340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.666065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.680783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1116/2243] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:07:54.682025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.692366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76cac-10b5-4178-890d-f4119dc79624 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.698194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6b3fd-9276-4413-82a2-515adfb3fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.699358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b3fd-9276-4413-82a2-515adfb3fe49 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.699638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b3fd-9276-4413-82a2-515adfb3fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.699915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b3fd-9276-4413-82a2-515adfb3fe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.700666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b3fd-9276-4413-82a2-515adfb3fe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.702283 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b3fd-9276-4413-82a2-515adfb3fe49 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.717226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1128/2244] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:07:54.718306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.729836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f868a-51e5-45d3-934d-93c5a9252814 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.735938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.737313 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.737980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.738352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] PATH_INFO: `/v3/projects/1dc1444d15fe4fe5a6110098b4926aa0/users/c25b3bc775494dc5ab7f1158d4a5f721/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.757601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc1444d15fe4fe5a6110098b4926aa0, user_id=c25b3bc775494dc5ab7f1158d4a5f721, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:54.760264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:54.776023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1117/2245] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:07:54 2021] PUT /identity/v3/projects/1dc1444d15fe4fe5a6110098b4926aa0/users/c25b3bc775494dc5ab7f1158d4a5f721/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:07:54.786463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.786779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.787015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.814332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] MFA Rules not processed for user `c25b3bc775494dc5ab7f1158d4a5f721`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:54.815555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:54.882091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1129/2246] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:54 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:54.894882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:54.896711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:54.983301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8f403-e4ae-491d-9103-20b654e5efed admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:54.987125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:54.987770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:54.988046 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:54.988317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:54.998684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:55.000289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:55.009833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1118/2247] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:07:54 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:07:57.489628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:57.491174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:57.559550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1ec9f-25ca-4021-9028-b591f8cdfd63 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:57.566901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:57.568588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:57.570394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:57.571001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] PATH_INFO: `/v3/users/1b47404ef24941829d657acb729f93da` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:57.572672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b47404ef24941829d657acb729f93da)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:57.575341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:57.627069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b47404ef24941829d657acb729f93da'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.636658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b47404ef24941829d657acb729f93da'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.644439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b47404ef24941829d657acb729f93da'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.645152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b47404ef24941829d657acb729f93da'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.657134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c01a256f-3893-4851-9614-ac4443e91cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b47404ef24941829d657acb729f93da'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.663483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1130/2248] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:07:57 2021] DELETE /identity/v3/users/1b47404ef24941829d657acb729f93da => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:57.832033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:57.846370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa4d4d-864c-45fd-92a9-fe4dde580614 service glance] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:57.903062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:57.903982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:57.904259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:57.904524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] PATH_INFO: `/v3/projects/04e0b910ad794c7db450e6bb1c96cd01` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:57.905757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e0b910ad794c7db450e6bb1c96cd01)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:57.907671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:57.953529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e0b910ad794c7db450e6bb1c96cd01', 'request_id': 'req-34472096-5183-4d38-8002-3ec8d72883a7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.959872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e0b910ad794c7db450e6bb1c96cd01', 'request_id': 'req-34472096-5183-4d38-8002-3ec8d72883a7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.966790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e0b910ad794c7db450e6bb1c96cd01', 'request_id': 'req-34472096-5183-4d38-8002-3ec8d72883a7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.976448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] The token cache is being invalidate because project 04e0b910ad794c7db450e6bb1c96cd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:07:57.976726 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.977338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-34472096-5183-4d38-8002-3ec8d72883a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:07:57.978914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1119/2249] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:07:57 2021] DELETE /identity/v3/projects/04e0b910ad794c7db450e6bb1c96cd01 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:57.984694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:57.984980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:57.985254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.003199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:58.004394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:58.066014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1131/2250] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:58.074992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.075282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.075560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.093477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:58.094814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:58.103133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1120/2251] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:07:58.108537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.118095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8f96f-64d8-49fc-b290-b5451e514337 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.124098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.124868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.125042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.125311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.126067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:07:58.126407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.128001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.141913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1132/2252] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:07:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:07:58.155088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.164981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7d637-b06f-4a7b-b3c9-499b74d58244 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.170638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.171432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.171719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.172061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.172833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.174834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.202477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1121/2253] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:07:58 2021] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:07:58.206741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.217362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8475d-1c89-42d8-91b5-e772eadae815 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.283260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.284266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.284683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.285022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.285980 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.288347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.310782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1133/2254] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:07:58 2021] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:07:58.314540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.327354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e164dc-42d5-421a-9992-f5346bc257a9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.332866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.333754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.334126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.334544 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.335295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.336891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.348412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1122/2255] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:07:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:07:58.352486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.363022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3106d-3348-4f60-9cba-4f0f93ffd67c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.368440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81642b-a199-4edb-aa5e-0bdf2578f46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.369104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81642b-a199-4edb-aa5e-0bdf2578f46f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.369415 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81642b-a199-4edb-aa5e-0bdf2578f46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.369685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81642b-a199-4edb-aa5e-0bdf2578f46f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.371252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81642b-a199-4edb-aa5e-0bdf2578f46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.372825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81642b-a199-4edb-aa5e-0bdf2578f46f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.387144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1134/2256] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:07:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:07:58.388827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.398919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3d1fd-eb82-455d-ad6a-f1fd5f038bc5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.403585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.404449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.404723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.404990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] PATH_INFO: `/v3/projects/5ef17fe958954b9a9fabeb4c2aa1a86f/users/0a46d1c953fb47148f1301c91d7d43c4/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.420136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef17fe958954b9a9fabeb4c2aa1a86f, user_id=0a46d1c953fb47148f1301c91d7d43c4, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.422857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.437339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1123/2257] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:07:58 2021] PUT /identity/v3/projects/5ef17fe958954b9a9fabeb4c2aa1a86f/users/0a46d1c953fb47148f1301c91d7d43c4/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:07:58.447149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.447435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.447716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.476158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] MFA Rules not processed for user `0a46d1c953fb47148f1301c91d7d43c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:07:58.477448 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:58.559626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1135/2258] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:07:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:07:58.571221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:07:58.572929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:07:58.674845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3420a77-7aa3-473a-88fd-13c7915bb879 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:07:58.681127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f4e60-d25b-4683-809c-cbe5fd038ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:07:58.681775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4e60-d25b-4683-809c-cbe5fd038ba8 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:07:58.682055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4e60-d25b-4683-809c-cbe5fd038ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:07:58.682365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f4e60-d25b-4683-809c-cbe5fd038ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:07:58.691365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4e60-d25b-4683-809c-cbe5fd038ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:07:58.692940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f4e60-d25b-4683-809c-cbe5fd038ba8 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:07:58.702538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1124/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:07:58 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:08:01.408542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:01.498646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabebc4b-3fba-48c0-b20a-6c01d87c3779 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:01.503144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:01.504031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:01.504307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:01.504582 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] PATH_INFO: `/v3/users/0a46d1c953fb47148f1301c91d7d43c4` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:01.505789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a46d1c953fb47148f1301c91d7d43c4)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:01.507748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:01.566382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a46d1c953fb47148f1301c91d7d43c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:01.574984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a46d1c953fb47148f1301c91d7d43c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:01.582100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a46d1c953fb47148f1301c91d7d43c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:01.582830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a46d1c953fb47148f1301c91d7d43c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:01.595116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a46d1c953fb47148f1301c91d7d43c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:01.601125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1136/2260] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:08:01 2021] DELETE /identity/v3/users/0a46d1c953fb47148f1301c91d7d43c4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:08:01.606494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:01.606976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:01.607070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:01.624106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:08:01.625325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:01.683788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1125/2261] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:08:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:08:01.693690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:01.695662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:01.757896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9dc61-a624-498a-b266-5dbdbe572d8d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:01.774474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d68e4-9bba-4ad9-8ac8-dfb522cf1bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:01.775174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d68e4-9bba-4ad9-8ac8-dfb522cf1bbd service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:01.775458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d68e4-9bba-4ad9-8ac8-dfb522cf1bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:01.775731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d68e4-9bba-4ad9-8ac8-dfb522cf1bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:01.804111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d68e4-9bba-4ad9-8ac8-dfb522cf1bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:01.806231 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d68e4-9bba-4ad9-8ac8-dfb522cf1bbd service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:01.818282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1137/2262] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:08:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:08:02.188804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.195056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:02.224079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b555127-fbf7-4bd0-ba67-2e5303df05a2 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.242242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.243531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.244130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.244571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] PATH_INFO: `/v3/projects/5ef17fe958954b9a9fabeb4c2aa1a86f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.246123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef17fe958954b9a9fabeb4c2aa1a86f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.248295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.318438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef17fe958954b9a9fabeb4c2aa1a86f', 'request_id': 'req-accd5f3e-a80a-420f-8eed-4b96fc629166'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:02.325680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef17fe958954b9a9fabeb4c2aa1a86f', 'request_id': 'req-accd5f3e-a80a-420f-8eed-4b96fc629166'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:02.333881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef17fe958954b9a9fabeb4c2aa1a86f', 'request_id': 'req-accd5f3e-a80a-420f-8eed-4b96fc629166'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:02.344182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] The token cache is being invalidate because project 5ef17fe958954b9a9fabeb4c2aa1a86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:08:02.344463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:02.345085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-accd5f3e-a80a-420f-8eed-4b96fc629166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:02.346661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1126/2263] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:08:02 2021] DELETE /identity/v3/projects/5ef17fe958954b9a9fabeb4c2aa1a86f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:02.352920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.353236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.353547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.372282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:08:02.373514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:02.432819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1138/2264] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:08:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:08:02.440333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.440620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.440898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.460320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:08:02.461547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:02.473394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1127/2265] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:08:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:08:02.474714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.489264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8dde1-2091-4d35-bfcd-59b5e12364dc None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.494218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.495456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.495759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.496056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.496839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:08:02.497163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.498884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.515322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1139/2266] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:08:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:08:02.516720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.525813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b7a45-6c02-48b1-a0e2-268ec621f129 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.530866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.531519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.531798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.532070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.532806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.534739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.561987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1128/2267] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:08:02 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:08:02.566307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.576556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bba5d-a1b0-44c4-8df6-b09920ffddb7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.636188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.637079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.637388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.637661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.638408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.640590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.664167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1140/2268] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:08:02 2021] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:08:02.667294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.678204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb75b7d-4c74-438a-841e-03732020610d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.683714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.684397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.684679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.684952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.685703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.687318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.697699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1129/2269] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:08:02.701767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.712099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9770d-6772-4a55-9c0a-6ad8c303c283 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.717854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98bad5-1aeb-4842-803c-799d3f7d0456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.718822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98bad5-1aeb-4842-803c-799d3f7d0456 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.719101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98bad5-1aeb-4842-803c-799d3f7d0456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.719512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98bad5-1aeb-4842-803c-799d3f7d0456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.720567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98bad5-1aeb-4842-803c-799d3f7d0456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.722830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98bad5-1aeb-4842-803c-799d3f7d0456 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.734710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1141/2270] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:08:02.738843 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.749326 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21af2d-a352-4f88-8339-5c95553fb0e6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.754071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.755246 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.755677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.755976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] PATH_INFO: `/v3/projects/74d8fe51b40a4e708d0e3fe45e953c78/users/6882710a671a409eae3288b884067703/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.777053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d8fe51b40a4e708d0e3fe45e953c78, user_id=6882710a671a409eae3288b884067703, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.780302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:02.795838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1130/2271] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:08:02 2021] PUT /identity/v3/projects/74d8fe51b40a4e708d0e3fe45e953c78/users/6882710a671a409eae3288b884067703/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:02.812560 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.812911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.813322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.844590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] MFA Rules not processed for user `6882710a671a409eae3288b884067703`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:08:02.845839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:02.911155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1142/2272] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:08:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:08:02.915813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:02.978349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ded0cf-99e0-49bd-8df5-0fd951ff2fb4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:02.983654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:02.984309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:02.984590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:02.984862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:02.985563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:02.987498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.028044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1131/2273] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:08:02 2021] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:08:03.030666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.042615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2e2e-15ac-4016-8ddd-6b281f941b88 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.102091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.102712 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.102990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.103260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.104581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.106630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.128065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1143/2274] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:08:03 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:08:03.132234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.142872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9306-476a-450b-a9f7-b2fbc590bfbd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.147560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.148204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.148488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.148765 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.149513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.151681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.162170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1132/2275] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:08:03.166085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.176334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27d63-7c33-485d-94fc-ff7b5769fce5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.180868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.181720 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.181996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.182344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] PATH_INFO: `/v3/projects/682e85873cad451c8a0504f29a836788/users/01cc3adc1fc042519213746457058c47/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.196096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682e85873cad451c8a0504f29a836788, user_id=01cc3adc1fc042519213746457058c47, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.198790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.211098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1144/2276] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:08:03 2021] PUT /identity/v3/projects/682e85873cad451c8a0504f29a836788/users/01cc3adc1fc042519213746457058c47/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:03.215630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.225596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0cb20-51a1-49ff-b4d9-0cb55b5c6e6e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.284519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310546-70fe-4f4f-9351-31af0ddeced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.285185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310546-70fe-4f4f-9351-31af0ddeced3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.285469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310546-70fe-4f4f-9351-31af0ddeced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.285748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310546-70fe-4f4f-9351-31af0ddeced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.286518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310546-70fe-4f4f-9351-31af0ddeced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.288109 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee310546-70fe-4f4f-9351-31af0ddeced3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.298632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1133/2277] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:08:03.302913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.312787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72981791-2c87-4b68-8aff-82fc363d0128 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.317387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.318372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.318651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.318924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] PATH_INFO: `/v3/projects/682e85873cad451c8a0504f29a836788/users/01cc3adc1fc042519213746457058c47/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.320903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682e85873cad451c8a0504f29a836788, user_id=01cc3adc1fc042519213746457058c47, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.323545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.333935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1145/2278] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:08:03 2021] PUT /identity/v3/projects/682e85873cad451c8a0504f29a836788/users/01cc3adc1fc042519213746457058c47/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:03.347674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.347957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.348239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.379354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] MFA Rules not processed for user `01cc3adc1fc042519213746457058c47`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:08:03.380473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:03.449217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1134/2279] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:08:03 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:08:03.460324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.462075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:03.516836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923190b-512c-436d-a0f5-f2f8f1987967 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.520476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.521104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.521383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.521656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.531848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.533266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.544743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1146/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:08:03 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:08:03.617894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:03.628990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a082587-f2cf-467a-a7b2-150d9e79333d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:03.632689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe376a-f083-43f8-aa45-e1bc4ab82510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:03.633328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe376a-f083-43f8-aa45-e1bc4ab82510 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:03.633603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe376a-f083-43f8-aa45-e1bc4ab82510 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:03.633877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe376a-f083-43f8-aa45-e1bc4ab82510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:03.692350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe376a-f083-43f8-aa45-e1bc4ab82510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:03.693945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe376a-f083-43f8-aa45-e1bc4ab82510 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:03.703176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1135/2281] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:08:03 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:08:54.329206 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:54.330669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:54.403835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e6496-2c8f-4adb-b97d-de729ea17b88 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:54.408675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:54.409537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:54.409819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:54.410091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] PATH_INFO: `/v3/users/c25b3bc775494dc5ab7f1158d4a5f721` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:54.411322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25b3bc775494dc5ab7f1158d4a5f721)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:54.413246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:54.462302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25b3bc775494dc5ab7f1158d4a5f721'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:54.473368 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25b3bc775494dc5ab7f1158d4a5f721'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:54.481669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25b3bc775494dc5ab7f1158d4a5f721'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:54.482431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25b3bc775494dc5ab7f1158d4a5f721'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:54.496197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25b3bc775494dc5ab7f1158d4a5f721'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:54.506839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1147/2282] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:08:54 2021] DELETE /identity/v3/users/c25b3bc775494dc5ab7f1158d4a5f721 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:54.508549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:54.509075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:54.509231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:54.546607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:08:54.548024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:54.658609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1136/2283] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:08:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:08:54.672278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:54.673908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:54.772095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fce7-9f72-4138-b514-66a7bb9b852a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:54.778642 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:54.779828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:54.780646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:54.780925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:54.793101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:54.794580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:54.819139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1148/2284] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:08:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:08:54.895021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:54.899048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:54.921069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa78786-4d01-47f0-a93c-816af5650c71 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:54.936210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:54.939380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:54.939852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:54.940282 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] PATH_INFO: `/v3/users/047982e41574460caa4bf3b79a9a8370` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:54.941746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=047982e41574460caa4bf3b79a9a8370)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:54.943697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:54.997400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047982e41574460caa4bf3b79a9a8370'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.008996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047982e41574460caa4bf3b79a9a8370'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.018861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047982e41574460caa4bf3b79a9a8370'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.030640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047982e41574460caa4bf3b79a9a8370'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.031372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047982e41574460caa4bf3b79a9a8370'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.037335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1137/2285] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:08:54 2021] DELETE /identity/v3/users/047982e41574460caa4bf3b79a9a8370 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:55.128376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:55.130827 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:55.150465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617ff82-2b43-47aa-ba15-876f34214892 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:55.224809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:55.226030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:55.228313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:55.228313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] PATH_INFO: `/v3/projects/1dc1444d15fe4fe5a6110098b4926aa0` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:55.228528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:55.229382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc1444d15fe4fe5a6110098b4926aa0)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:55.230612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:55.232582 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:55.249140 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f487-a151-4532-93f2-189cc61ff87e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:55.254216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:55.255143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:55.255427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:55.255701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] PATH_INFO: `/v3/projects/e65fe36399a34538b3b4da9464f43df3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:55.256933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65fe36399a34538b3b4da9464f43df3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:55.259596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:55.286742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc1444d15fe4fe5a6110098b4926aa0', 'request_id': 'req-b4f74414-e016-4532-a838-603a74d20b28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.293394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc1444d15fe4fe5a6110098b4926aa0', 'request_id': 'req-b4f74414-e016-4532-a838-603a74d20b28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.300567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc1444d15fe4fe5a6110098b4926aa0', 'request_id': 'req-b4f74414-e016-4532-a838-603a74d20b28'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.311616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65fe36399a34538b3b4da9464f43df3', 'request_id': 'req-8b0ac86d-d690-4867-9ce2-348d100b3493'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.311852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] The token cache is being invalidate because project 1dc1444d15fe4fe5a6110098b4926aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:08:55.312170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.312826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.314408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1149/2286] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:08:55 2021] DELETE /identity/v3/projects/1dc1444d15fe4fe5a6110098b4926aa0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:55.319264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65fe36399a34538b3b4da9464f43df3', 'request_id': 'req-8b0ac86d-d690-4867-9ce2-348d100b3493'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.328497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65fe36399a34538b3b4da9464f43df3', 'request_id': 'req-8b0ac86d-d690-4867-9ce2-348d100b3493'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.340382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] The token cache is being invalidate because project e65fe36399a34538b3b4da9464f43df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:08:55.340671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.341344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:08:55.343185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1138/2287] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:08:55 2021] DELETE /identity/v3/projects/e65fe36399a34538b3b4da9464f43df3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:08:56.776988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:56.778410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:56.834341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74414-e016-4532-a838-603a74d20b28 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:56.879963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:56.880689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:56.880981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:56.881244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:56.883019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:56.952044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:56.953472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ec739-05b2-4159-8e6f-1a53041d39c6 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:56.964256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1150/2288] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:08:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:08:58.230596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:08:58.232132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:58.245297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ac86d-d690-4867-9ce2-348d100b3493 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:08:58.253445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:08:58.254110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:08:58.254496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:08:58.254775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:08:58.257249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:08:58.271524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:08:58.272950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:08:58.285365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1139/2289] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:08:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:03.049877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:03.050406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:03.050815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:03.069324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] MFA Rules not processed for user `a1431bb04bd14db986edcf8931bc2210`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:03.070553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:03.159208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1151/2290] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:03 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:03.469831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:03.471243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:03.481891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31cf5f-ce5c-4114-842b-8a34abd1bf73 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:03.485464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:03.486084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:03.486398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:03.486672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:03.488370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:03.497876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:03.499331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:03.506966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1140/2291] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:03.817009 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:03.818425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:03.886752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed73a7-70c8-4111-87c9-f7d20cf162b7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:03.891984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:03.892614 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:03.892891 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:03.893180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:03.895029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:03.906439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:03.907992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:03.918006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1152/2292] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:04.873866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:04.874714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:04.875258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:04.886478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe83e0-1cdf-4279-9aec-f0e16e929782 service placement] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:04.891142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:04.891815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:04.892295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:04.892587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:04.893019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b943bf-8475-4159-b629-1286a17390db service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:04.894737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:04.899519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b25b9-f719-49a0-9c0e-f09273e5ba00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:04.900174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b25b9-f719-49a0-9c0e-f09273e5ba00 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:04.900642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b25b9-f719-49a0-9c0e-f09273e5ba00 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:04.901055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b25b9-f719-49a0-9c0e-f09273e5ba00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:04.909224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:04.910832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:04.911378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b25b9-f719-49a0-9c0e-f09273e5ba00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:04.913148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b25b9-f719-49a0-9c0e-f09273e5ba00 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:04.922660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1153/2293] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:04 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:04.923009 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1141/2294] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:04 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:06.054591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:06.056018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:06.128437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162a128-e778-4fc3-88c2-2d02333ef44c service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:06.140132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:06.141025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:06.141307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:06.141603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] PATH_INFO: `/v3/users/6882710a671a409eae3288b884067703` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:06.142922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6882710a671a409eae3288b884067703)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:06.144984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:06.203278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6882710a671a409eae3288b884067703'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:06.212535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6882710a671a409eae3288b884067703'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:06.233454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6882710a671a409eae3288b884067703'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:06.234421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6882710a671a409eae3288b884067703'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:06.250505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6882710a671a409eae3288b884067703'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:06.261588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1154/2295] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:06 2021] DELETE /identity/v3/users/6882710a671a409eae3288b884067703 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:06.266667 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:06.268851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:06.269341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:06.291086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:06.292575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:06.361320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1142/2296] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:06.373099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:06.374715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:06.455749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219ab3-3b4e-4b5c-8135-09117132112d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:06.459719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:06.460745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:06.461353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:06.462022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:06.475050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:06.476572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:06.489495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1155/2297] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:06.946331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:06.947822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:06.959910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d969dc3-a396-4518-9432-4b83de69fa6d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:06.965375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:06.966276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:06.966554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:06.966824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] PATH_INFO: `/v3/projects/74d8fe51b40a4e708d0e3fe45e953c78` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:06.968053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d8fe51b40a4e708d0e3fe45e953c78)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:06.969959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:07.019490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d8fe51b40a4e708d0e3fe45e953c78', 'request_id': 'req-b2e92efe-2600-4024-ab23-fe70142a81d7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.027180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d8fe51b40a4e708d0e3fe45e953c78', 'request_id': 'req-b2e92efe-2600-4024-ab23-fe70142a81d7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.034200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d8fe51b40a4e708d0e3fe45e953c78', 'request_id': 'req-b2e92efe-2600-4024-ab23-fe70142a81d7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.044142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] The token cache is being invalidate because project 74d8fe51b40a4e708d0e3fe45e953c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:07.044426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.045078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.046645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1143/2298] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:06 2021] DELETE /identity/v3/projects/74d8fe51b40a4e708d0e3fe45e953c78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:07.050553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:07.059988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42a0be-5635-4cc7-b700-c88d4a8de735 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:07.114128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:07.115142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.115421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.115702 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] PATH_INFO: `/v3/users/01cc3adc1fc042519213746457058c47` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.116899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cc3adc1fc042519213746457058c47)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:07.118854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:07.165109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cc3adc1fc042519213746457058c47'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.173107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cc3adc1fc042519213746457058c47'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.179775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cc3adc1fc042519213746457058c47'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.180401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cc3adc1fc042519213746457058c47'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.192327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-45516013-342c-484f-80f9-45ebf747bb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cc3adc1fc042519213746457058c47'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.198035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1156/2299] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:07 2021] DELETE /identity/v3/users/01cc3adc1fc042519213746457058c47 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:07.479043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:07.481747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:07.505437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e92efe-2600-4024-ab23-fe70142a81d7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:07.563380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:07.564238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.564523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.564798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] PATH_INFO: `/v3/projects/682e85873cad451c8a0504f29a836788` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.566005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] RBAC: Authorizing `identity:delete_project(project_id=682e85873cad451c8a0504f29a836788)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:07.568018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:07.616443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682e85873cad451c8a0504f29a836788', 'request_id': 'req-8a958c31-a786-4b7b-9fe7-df68b45452db'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.624249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682e85873cad451c8a0504f29a836788', 'request_id': 'req-8a958c31-a786-4b7b-9fe7-df68b45452db'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.633126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682e85873cad451c8a0504f29a836788', 'request_id': 'req-8a958c31-a786-4b7b-9fe7-df68b45452db'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.643578 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] The token cache is being invalidate because project 682e85873cad451c8a0504f29a836788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:07.643865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.644508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8a958c31-a786-4b7b-9fe7-df68b45452db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:07.646026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1144/2300] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:07 2021] DELETE /identity/v3/projects/682e85873cad451c8a0504f29a836788 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:07.652217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.652580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.652960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.672232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:07.673569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:07.731919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1157/2301] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:07.740485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.740768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.741045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.759110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:07.760297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:07.768789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1145/2302] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:07.772931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:07.784532 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f6d3-cbc7-434c-a397-ddd8d6bcdcf1 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:07.789215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:07.790055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.790371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.790643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.791378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:07.791675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:07.793668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:07.819519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1158/2303] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:09:07.821045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:07.831923 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc81a6-ed93-46b7-b66c-1e9f9c9addc4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:07.836837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:07.837533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.837813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.838091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.838881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:07.841340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:07.867788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1146/2304] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:07 2021] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:07.872001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:07.881937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca380e-9da3-4a02-b98f-3e9e61b54ece admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:07.947337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:07.948635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.949040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.949338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.950069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:07.952339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:07.972217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1159/2305] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:07 2021] POST /identity/v3/users => generated 278 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:07.976214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:07.986553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4374e6-1f55-4e3e-ac3d-2683b86f9d88 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:07.990982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:07.991619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:07.991895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:07.992163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:07.992897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:07.994549 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.004811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1147/2306] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:08.008519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.018860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9dcb8-03ca-4e88-ab50-9d0123a62eba admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.023416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fcedd-9d60-4ed3-857c-21da7e845185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.024042 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fcedd-9d60-4ed3-857c-21da7e845185 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.024321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fcedd-9d60-4ed3-857c-21da7e845185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.024594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fcedd-9d60-4ed3-857c-21da7e845185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.025331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fcedd-9d60-4ed3-857c-21da7e845185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.027966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fcedd-9d60-4ed3-857c-21da7e845185 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.037463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1160/2307] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:08.041377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.051098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca5fa-b8bd-4973-92c1-495360b80598 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.056026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.056912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.057191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.057468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] PATH_INFO: `/v3/projects/e7d06036f3ab4343ab24f48c7b0bcaeb/users/a7edc535bc824ba2bf694e194c99d0f0/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.071285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d06036f3ab4343ab24f48c7b0bcaeb, user_id=a7edc535bc824ba2bf694e194c99d0f0, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.074441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.086629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1148/2308] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:08 2021] PUT /identity/v3/projects/e7d06036f3ab4343ab24f48c7b0bcaeb/users/a7edc535bc824ba2bf694e194c99d0f0/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:08.102217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.102797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.102797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.128131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] MFA Rules not processed for user `a7edc535bc824ba2bf694e194c99d0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:08.129330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:08.191168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1161/2309] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:08 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:08.195592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.255243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6aed4-a953-45dd-a357-ba34095244f4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.259757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.260398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.261234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.261506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.262239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.264426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.288630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1149/2310] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:08 2021] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:08.293151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.303651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd27e2-340c-46ba-8ec6-2e0de23a30b7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.360661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.361324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.361603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.361876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.362628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.364528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.384379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1162/2311] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:08 2021] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:08.389161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.399135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912286cd-2dff-4198-a2ae-7077c9ad57ef admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.403757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.404394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.404671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.404938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.405660 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.407270 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.418342 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1150/2312] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:08.422255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.432226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77b57f-7da3-49a5-97c1-0d3b936b3af3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.437486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.438407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.438685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.438953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] PATH_INFO: `/v3/projects/f632b47323894860a84ad7694b7d2d95/users/4cd42f48c6cd40739343eb956d1a488d/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.453829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f632b47323894860a84ad7694b7d2d95, user_id=4cd42f48c6cd40739343eb956d1a488d, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.456555 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.471430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1163/2313] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:08 2021] PUT /identity/v3/projects/f632b47323894860a84ad7694b7d2d95/users/4cd42f48c6cd40739343eb956d1a488d/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:08.475388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.485134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f7462-2a44-44db-94ac-70a65e590d8c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.541314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe1ed0-a97b-428f-8c13-305d3855b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.542550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1ed0-a97b-428f-8c13-305d3855b8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.542831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1ed0-a97b-428f-8c13-305d3855b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.543104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe1ed0-a97b-428f-8c13-305d3855b8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.543851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe1ed0-a97b-428f-8c13-305d3855b8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.545440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe1ed0-a97b-428f-8c13-305d3855b8c3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.558675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1151/2314] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:08 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:08.559857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.570592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add174d7-d2f8-46a4-a17a-f873bd2b799a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.575483 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.576362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.577016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.577016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] PATH_INFO: `/v3/projects/f632b47323894860a84ad7694b7d2d95/users/4cd42f48c6cd40739343eb956d1a488d/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.578905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f632b47323894860a84ad7694b7d2d95, user_id=4cd42f48c6cd40739343eb956d1a488d, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.581544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.591957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1164/2315] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:08 2021] PUT /identity/v3/projects/f632b47323894860a84ad7694b7d2d95/users/4cd42f48c6cd40739343eb956d1a488d/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:08.602784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.603073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.603353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.630967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] MFA Rules not processed for user `4cd42f48c6cd40739343eb956d1a488d`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:08.632362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:08.706339 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1152/2316] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:08 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:08.716733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.718674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:08.784165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba54407-6b2d-4435-9bf6-5b70a7f6b6b8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.788144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.789474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.789820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.790123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.799945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.801372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.814774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1165/2317] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:08 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:08.882127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:08.891938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892e4f-bbc4-451a-8497-d27ae5fbef94 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:08.895492 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:08.896118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:08.896397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:08.896664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:08.949847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:08.951653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:08.961346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1153/2318] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:08 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:13.702414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:13.705136 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:13.780833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884d285-e156-4661-b222-503e64e0e629 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:13.784783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:13.785479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:13.785853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:13.786538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:13.789001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:13.799475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:13.801032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:13.817193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1166/2319] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:14.731727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:14.735151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:14.838689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e134-f6a6-4b3c-8e7b-fd31b1afb21b service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:14.843213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:14.844073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:14.844353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:14.844627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] PATH_INFO: `/v3/users/a40300c1b04e4f3c9e9063c1d0d47a9a` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:14.845886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40300c1b04e4f3c9e9063c1d0d47a9a)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:14.847798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:14.894992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40300c1b04e4f3c9e9063c1d0d47a9a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:14.903457 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40300c1b04e4f3c9e9063c1d0d47a9a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:14.913656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40300c1b04e4f3c9e9063c1d0d47a9a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:14.929042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40300c1b04e4f3c9e9063c1d0d47a9a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:14.929769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0e61cefd-6d66-496c-9a13-f7468b25d0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40300c1b04e4f3c9e9063c1d0d47a9a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:14.936495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1154/2320] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:14 2021] DELETE /identity/v3/users/a40300c1b04e4f3c9e9063c1d0d47a9a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:15.137767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.168850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb0530-2fe2-4252-b2ba-099d87fdb1cc service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.231492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.232360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.232637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.232903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] PATH_INFO: `/v3/projects/3c8d022ad9f948729c91e72aed09c8cd` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.234573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8d022ad9f948729c91e72aed09c8cd)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:15.236481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:15.281608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8d022ad9f948729c91e72aed09c8cd', 'request_id': 'req-6093fe65-6d80-47b3-ab65-57ec66361df3'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:15.287563 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8d022ad9f948729c91e72aed09c8cd', 'request_id': 'req-6093fe65-6d80-47b3-ab65-57ec66361df3'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:15.296546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8d022ad9f948729c91e72aed09c8cd', 'request_id': 'req-6093fe65-6d80-47b3-ab65-57ec66361df3'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:15.307513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] The token cache is being invalidate because project 3c8d022ad9f948729c91e72aed09c8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:15.307738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:15.308367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6093fe65-6d80-47b3-ab65-57ec66361df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:15.309968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1167/2321] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:15 2021] DELETE /identity/v3/projects/3c8d022ad9f948729c91e72aed09c8cd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:15.315768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261074-513a-4bee-ad56-66276b33f790 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.316057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261074-513a-4bee-ad56-66276b33f790 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.316425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261074-513a-4bee-ad56-66276b33f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.334188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-88261074-513a-4bee-ad56-66276b33f790 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:15.335496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-88261074-513a-4bee-ad56-66276b33f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:15.403298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1155/2322] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:15.410928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.411214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.411493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.430437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:15.431962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:15.446193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1168/2323] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:15.446979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261074-513a-4bee-ad56-66276b33f790 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.457110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261074-513a-4bee-ad56-66276b33f790 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.462699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.464027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.464410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.464767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.466205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:15.466205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:15.467690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:15.484964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1156/2324] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:09:15.488819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.523514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08de28e-aad4-459e-abdd-68cda3dba4e3 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.540161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.540845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.541120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.541426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.542207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:15.544161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:15.619006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1169/2325] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:15 2021] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:15.623060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.647688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115ceab-fb8d-417a-aa55-f797aed46a0b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.735074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.737732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:15.765685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.766506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.766878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.767249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.768065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:15.771777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:15.839344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1157/2326] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:15 2021] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:15.844281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.857568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d9324-34a1-45ff-9d10-ceffce488cc9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.857806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465415e-4279-482c-95ce-a94b85f2e2b3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.862619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.863343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.864172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.864703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.865134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.866055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:15.866214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.868158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:15.881625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.882812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.889112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1158/2327] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:15.890994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:15.898085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:15.915384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0583-1dc7-4d2b-bd5b-9c9da0e0119d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:15.930466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:15.934212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:15.935131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:15.935658 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:15.937719 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:15.939819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:15.968651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1159/2328] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:15 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:15.973825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:16.007637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc144-3d67-4056-84df-5187d20d50e5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:16.021214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:16.023605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d696d02-2739-4405-8499-5ec521f214d0 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:16.030187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:16.031241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:16.031528 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:16.032284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] PATH_INFO: `/v3/projects/4cc2d253538b412baa02f96143d99026/users/c84f2dd9c42b4d1b80c6b664010a0d7b/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:16.043225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1170/2329] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:15 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:16.072256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc2d253538b412baa02f96143d99026, user_id=c84f2dd9c42b4d1b80c6b664010a0d7b, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:16.078264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:16.121937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1160/2330] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:15 2021] PUT /identity/v3/projects/4cc2d253538b412baa02f96143d99026/users/c84f2dd9c42b4d1b80c6b664010a0d7b/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:16.125326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528365-49e7-4267-94be-68b17a396836 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:16.125657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528365-49e7-4267-94be-68b17a396836 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:16.125919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528365-49e7-4267-94be-68b17a396836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:16.169209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-39528365-49e7-4267-94be-68b17a396836 None None] MFA Rules not processed for user `c84f2dd9c42b4d1b80c6b664010a0d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:16.170469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-39528365-49e7-4267-94be-68b17a396836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:16.253562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1171/2331] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:16 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:16.275439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:16.277533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:16.360944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b1db-f81e-4b6d-b07c-d73365051fc9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:16.368241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:16.370594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:16.371461 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:16.371796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:16.380896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:16.383094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:16.394796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1161/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:16 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:17.576504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528365-49e7-4267-94be-68b17a396836 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:17.578282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-39528365-49e7-4267-94be-68b17a396836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:17.601998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528365-49e7-4267-94be-68b17a396836 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:17.608697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:17.609793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:17.610523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:17.611024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:17.614001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:17.630341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:17.632155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc8bb5-cb5b-4924-96a1-ae46e0bbf54e service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:17.661761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1172/2333] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:23.805713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:23.891058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f6ae3-d996-46ec-9145-4fe9f5d6f047 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:23.896317 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:23.897256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:23.897609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:23.898583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] PATH_INFO: `/v3/users/c84f2dd9c42b4d1b80c6b664010a0d7b` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:23.899288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84f2dd9c42b4d1b80c6b664010a0d7b)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:23.901957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:23.951915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84f2dd9c42b4d1b80c6b664010a0d7b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:23.959024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84f2dd9c42b4d1b80c6b664010a0d7b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:23.966330 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84f2dd9c42b4d1b80c6b664010a0d7b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:23.977737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84f2dd9c42b4d1b80c6b664010a0d7b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:23.978480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84f2dd9c42b4d1b80c6b664010a0d7b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:23.984664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1162/2334] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:23 2021] DELETE /identity/v3/users/c84f2dd9c42b4d1b80c6b664010a0d7b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:23.989114 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:23.989988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:23.990294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.009062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:24.010772 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:24.073904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1173/2335] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:24.086626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:24.088198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:24.143990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a12b6e-5762-47f9-9765-35556978c127 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:24.147850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae28210-347f-4aea-b01f-54eb81613a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:24.148574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae28210-347f-4aea-b01f-54eb81613a20 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.148921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae28210-347f-4aea-b01f-54eb81613a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.149286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae28210-347f-4aea-b01f-54eb81613a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.158999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae28210-347f-4aea-b01f-54eb81613a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:24.160576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae28210-347f-4aea-b01f-54eb81613a20 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:24.170258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1163/2336] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:24.458542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:24.460228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:24.472857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d2a7f-d81d-42e7-a86f-42aa44b13931 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:24.478758 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:24.479931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.480530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.481109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] PATH_INFO: `/v3/projects/4cc2d253538b412baa02f96143d99026` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.482629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc2d253538b412baa02f96143d99026)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:24.485733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:24.545696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc2d253538b412baa02f96143d99026', 'request_id': 'req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:24.553357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc2d253538b412baa02f96143d99026', 'request_id': 'req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:24.563238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc2d253538b412baa02f96143d99026', 'request_id': 'req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:24.574750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] The token cache is being invalidate because project 4cc2d253538b412baa02f96143d99026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:24.575044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:24.575695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd10215b-eea6-4d7a-9beb-9bcb29acc8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:24.577459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1174/2337] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:24 2021] DELETE /identity/v3/projects/4cc2d253538b412baa02f96143d99026 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:24.582883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.583182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.583437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.600953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:24.602186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:24.680049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1164/2338] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:24.688223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.688768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.689144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.711449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:24.713395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:24.724108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1175/2339] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:24.729417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:24.739844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab79922-3fe2-424c-92cc-33d874ae1540 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:24.747605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:24.748252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.748521 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.749413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.750666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:24.750977 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:24.752901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:24.765795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1165/2340] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:24.770246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:24.790492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0557dc-868c-4330-8c69-526679f85d2d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:24.800808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:24.801397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.801670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.801945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.802690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:24.804581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:24.833447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1176/2341] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:24 2021] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:24.838065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:24.848826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481055a-2150-4f2e-ab44-16fc5587d00e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:24.914354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:24.915098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.915304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.915573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.919565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:24.922018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:24.946374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1166/2342] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:24 2021] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:24.951812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:24.964982 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3ff7f-8cf0-4eeb-b6af-e89a6f718c31 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:24.970315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:24.971232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:24.972107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:24.972107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:24.972977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:24.974859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:24.989228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1177/2343] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:24 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:24.990447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:25.000938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d407-1300-403d-9563-7aa3c0e7edda admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:25.005652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886ee94-b11b-408a-a991-3a3d9143b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:25.006357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886ee94-b11b-408a-a991-3a3d9143b552 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:25.006623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886ee94-b11b-408a-a991-3a3d9143b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:25.006897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886ee94-b11b-408a-a991-3a3d9143b552 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:25.007638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886ee94-b11b-408a-a991-3a3d9143b552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:25.009268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886ee94-b11b-408a-a991-3a3d9143b552 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:25.031471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1167/2344] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:25.033739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:25.047706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013ea4-86f2-4a1b-a5d1-f8f01fa19517 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:25.054923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:25.063590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:25.066289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:25.066689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] PATH_INFO: `/v3/projects/f3d808af82ee464b8e50e66f15fd0a84/users/c732ffe73d8d4746846af3fde1905134/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:25.085126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d808af82ee464b8e50e66f15fd0a84, user_id=c732ffe73d8d4746846af3fde1905134, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:25.088529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:25.104119 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1178/2345] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:25 2021] PUT /identity/v3/projects/f3d808af82ee464b8e50e66f15fd0a84/users/c732ffe73d8d4746846af3fde1905134/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:25.114764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358b20-1a88-417e-aa95-7ccf4f72f6d1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:25.115209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358b20-1a88-417e-aa95-7ccf4f72f6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:25.115675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358b20-1a88-417e-aa95-7ccf4f72f6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:25.146552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-16358b20-1a88-417e-aa95-7ccf4f72f6d1 None None] MFA Rules not processed for user `c732ffe73d8d4746846af3fde1905134`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:25.147943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-16358b20-1a88-417e-aa95-7ccf4f72f6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:25.232673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1168/2346] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:25 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:25.243238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:25.246288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:25.329445 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623945c2-e156-468d-a85b-bed8e8597d71 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:25.333434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:25.334223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:25.334509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:25.334783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:25.345222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:25.347229 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:25.372888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1179/2347] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:25 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:26.312464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604dafa-7068-4b70-9369-f593a9c7ef08 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:26.312950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604dafa-7068-4b70-9369-f593a9c7ef08 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:26.313083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604dafa-7068-4b70-9369-f593a9c7ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:26.333459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b604dafa-7068-4b70-9369-f593a9c7ef08 None None] MFA Rules not processed for user `ff7f1cc9a2214907871542822081375f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:26.334883 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b604dafa-7068-4b70-9369-f593a9c7ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:26.394176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1169/2348] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:26 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:26.483362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:26.485929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:26.550695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40894bfa-0bde-4e3f-ba85-f850ae7e722e service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:26.555290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:26.556572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:26.556862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:26.557135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] PATH_INFO: `/v3/users/a7edc535bc824ba2bf694e194c99d0f0` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:26.558387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7edc535bc824ba2bf694e194c99d0f0)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:26.561166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:26.612939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7edc535bc824ba2bf694e194c99d0f0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:26.620325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7edc535bc824ba2bf694e194c99d0f0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:26.627325 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7edc535bc824ba2bf694e194c99d0f0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:26.627961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7edc535bc824ba2bf694e194c99d0f0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:26.639968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7edc535bc824ba2bf694e194c99d0f0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:26.646070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1180/2349] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:26 2021] DELETE /identity/v3/users/a7edc535bc824ba2bf694e194c99d0f0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:26.651575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:26.651992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:26.652396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:26.670243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:26.671451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:26.722819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:26.724216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:26.729913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1170/2350] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:26.739480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:26.740798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:26.784666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6db440-a8ae-451f-8525-76985eb55286 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:26.788622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:26.789314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:26.789587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:26.790687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:26.794505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:26.799501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c76bb-c0ee-445d-a4b4-cffa81f0ba88 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:26.807408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:26.807408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:26.807408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:26.807408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:26.811200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:26.812835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced048b8-b8db-4b11-b207-7fb67d9da047 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:26.820904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:26.823854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1181/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:26 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:26.824028 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:26.837427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1171/2352] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:26.996716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:26.997160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:26.997520 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:27.019413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:27.020659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:27.083040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1182/2353] 10.222.0.57 () {58 vars in 967 bytes} [Wed Dec 15 13:09:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:27.163850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:27.166739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:27.293819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef84955-5baa-40d1-8752-3e698ac6f3e2 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:27.300325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:27.300990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:27.301410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:27.301702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:27.313738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:27.315486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:27.324323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1172/2354] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:09:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:09:27.350005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:27.351788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:27.381649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdfd48-8786-4b43-91ea-9b2a5e913245 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:27.388159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:27.389181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:27.389513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:27.389862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] PATH_INFO: `/v3/projects/e7d06036f3ab4343ab24f48c7b0bcaeb` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:27.394854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d06036f3ab4343ab24f48c7b0bcaeb)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:27.397384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:27.452317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d06036f3ab4343ab24f48c7b0bcaeb', 'request_id': 'req-111319d7-3ec2-4c82-a523-5d125c7aeaea'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.460593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d06036f3ab4343ab24f48c7b0bcaeb', 'request_id': 'req-111319d7-3ec2-4c82-a523-5d125c7aeaea'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.470714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d06036f3ab4343ab24f48c7b0bcaeb', 'request_id': 'req-111319d7-3ec2-4c82-a523-5d125c7aeaea'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.482540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] The token cache is being invalidate because project e7d06036f3ab4343ab24f48c7b0bcaeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:27.483090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.483928 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.489565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1183/2355] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:27 2021] DELETE /identity/v3/projects/e7d06036f3ab4343ab24f48c7b0bcaeb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:27.492735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:27.505620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a9303-7f8f-49a0-b975-4fe089b00b7e service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:27.579347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:27.580576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:27.580848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:27.581343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] PATH_INFO: `/v3/users/4cd42f48c6cd40739343eb956d1a488d` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:27.582831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd42f48c6cd40739343eb956d1a488d)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:27.585047 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:27.646453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd42f48c6cd40739343eb956d1a488d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.655681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd42f48c6cd40739343eb956d1a488d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.664055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd42f48c6cd40739343eb956d1a488d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.679335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd42f48c6cd40739343eb956d1a488d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.680593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-311b4544-7a35-47ca-8255-369553acd7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd42f48c6cd40739343eb956d1a488d'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:27.692143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1173/2356] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:27 2021] DELETE /identity/v3/users/4cd42f48c6cd40739343eb956d1a488d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:28.020979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.022781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:28.041012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111319d7-3ec2-4c82-a523-5d125c7aeaea admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.102472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.103394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.103675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.103945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] PATH_INFO: `/v3/projects/f632b47323894860a84ad7694b7d2d95` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.105151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f632b47323894860a84ad7694b7d2d95)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.107078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.154774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f632b47323894860a84ad7694b7d2d95', 'request_id': 'req-a7ac906e-f52e-4e07-9e0c-297377138700'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:28.160799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f632b47323894860a84ad7694b7d2d95', 'request_id': 'req-a7ac906e-f52e-4e07-9e0c-297377138700'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:28.169102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f632b47323894860a84ad7694b7d2d95', 'request_id': 'req-a7ac906e-f52e-4e07-9e0c-297377138700'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:28.179963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] The token cache is being invalidate because project f632b47323894860a84ad7694b7d2d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:28.180392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:28.181699 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a7ac906e-f52e-4e07-9e0c-297377138700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:28.183649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1184/2357] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:28 2021] DELETE /identity/v3/projects/f632b47323894860a84ad7694b7d2d95 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:28.189271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.189625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.189967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.212023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:28.213973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:28.302185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1174/2358] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:28.313945 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.314241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.314726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.344753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:28.344753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:28.358528 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1185/2359] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:28.360325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.371518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289e19-aa17-4a82-b361-33b7af168644 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.376712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.377384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.378119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.378452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.379208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:28.379515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.382133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.402200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1175/2360] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:28.404889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.415151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b11f9-7a91-49b8-b379-daaf715fd1d9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.432253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.433775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.438096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.439048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.440458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.454196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.527506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1186/2361] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:28 2021] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:28.529484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.546054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72474ca-c79c-4f4d-bcdf-5bd0bc3e89c5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.634112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.635720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.636067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.636419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.638200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.640385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.670694 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1176/2362] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:28 2021] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:28.672031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.686762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1303445-2dac-4431-80e4-0c8b60b0080e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.704499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.705350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.706275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.706654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.707652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.713878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.733513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1187/2363] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:28 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:28.738018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.756456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfb754-7361-442c-8346-1016f1d62405 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.765980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bd312-1b44-4f51-b6cb-099b5545f6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.768221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd312-1b44-4f51-b6cb-099b5545f6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.769525 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd312-1b44-4f51-b6cb-099b5545f6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.769812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd312-1b44-4f51-b6cb-099b5545f6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.770947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bd312-1b44-4f51-b6cb-099b5545f6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.773543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bd312-1b44-4f51-b6cb-099b5545f6fa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.786084 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1177/2364] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:28 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:28.792689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:28.815379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ab7e-64fa-4180-98e7-b77bd8db5529 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:28.833878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:28.835183 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.836056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.837529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] PATH_INFO: `/v3/projects/23d3eda90e624bce95e31b40a2a4a3f6/users/eebbc8296429420e8dc27dcf4e942519/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.855745 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d3eda90e624bce95e31b40a2a4a3f6, user_id=eebbc8296429420e8dc27dcf4e942519, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:28.859584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:28.917697 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1188/2365] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:28 2021] PUT /identity/v3/projects/23d3eda90e624bce95e31b40a2a4a3f6/users/eebbc8296429420e8dc27dcf4e942519/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:28.926978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:28.927992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:28.928596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:28.976312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] MFA Rules not processed for user `eebbc8296429420e8dc27dcf4e942519`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:28.977552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:29.104472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1178/2366] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:28 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:29.105716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:29.210089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dc0e9-e69b-4fa3-84da-9d6d99978673 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:29.218434 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:29.219691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.220130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.220615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.222809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:29.226501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:29.264930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1189/2367] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:29 2021] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:29.269531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:29.287230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7546e9-8c63-4675-bf79-443672d3b9e9 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:29.392355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:29.393470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.393964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.394569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.395277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:29.398930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:29.432955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1179/2368] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:29 2021] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:29.436319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:29.450217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200402d-9329-4485-9e50-a61dd9db5c7f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:29.457018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:29.457999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.458417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.458798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.459648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:29.461389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:29.480091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1190/2369] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:29 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:29.481469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:29.498871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ac696-40da-4586-b699-5bf6fd15cb03 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:29.505707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:29.506872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.507260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.507674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] PATH_INFO: `/v3/projects/f98089103e6b4cc8b8cad2ec28e7950c/users/d8e1364dd9224ffa92c488c07c6984e7/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.537468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98089103e6b4cc8b8cad2ec28e7950c, user_id=d8e1364dd9224ffa92c488c07c6984e7, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:29.542912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:29.577242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1180/2370] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:29 2021] PUT /identity/v3/projects/f98089103e6b4cc8b8cad2ec28e7950c/users/d8e1364dd9224ffa92c488c07c6984e7/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:29.579848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:29.592524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e2a6-3472-4963-806d-6f5fa6a01534 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:29.680431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024161c8-da6d-4a2c-98e1-0a00af86dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:29.681791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024161c8-da6d-4a2c-98e1-0a00af86dcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.682479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024161c8-da6d-4a2c-98e1-0a00af86dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.683171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024161c8-da6d-4a2c-98e1-0a00af86dcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.684632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024161c8-da6d-4a2c-98e1-0a00af86dcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:29.687911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024161c8-da6d-4a2c-98e1-0a00af86dcc8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:29.709271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1191/2371] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:29 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:29.715898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:29.735312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4f39-94bf-435c-ba6d-df5d975c0ff9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:29.745133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:29.747800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.748290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.749321 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] PATH_INFO: `/v3/projects/f98089103e6b4cc8b8cad2ec28e7950c/users/d8e1364dd9224ffa92c488c07c6984e7/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.753511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98089103e6b4cc8b8cad2ec28e7950c, user_id=d8e1364dd9224ffa92c488c07c6984e7, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:29.759833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:29.794680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1181/2372] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:29 2021] PUT /identity/v3/projects/f98089103e6b4cc8b8cad2ec28e7950c/users/d8e1364dd9224ffa92c488c07c6984e7/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:29.799442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:29.800385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:29.801165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:29.883669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] MFA Rules not processed for user `d8e1364dd9224ffa92c488c07c6984e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:29.885734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:29.980527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1192/2373] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:29 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:30.000257 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:30.008035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:30.135949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a1ae-9242-4d7e-9cc0-078b465d75c0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:30.140228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:30.141312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:30.141697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:30.142066 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:30.153643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:30.169802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:30.183250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1182/2374] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:29 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:30.342569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:30.354829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d29bcc-7af9-46b0-997d-1f01e3d04824 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:30.361798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbb0f2-8f50-4adf-8ab6-ac029fd31939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:30.362551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb0f2-8f50-4adf-8ab6-ac029fd31939 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:30.363632 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb0f2-8f50-4adf-8ab6-ac029fd31939 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:30.364207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb0f2-8f50-4adf-8ab6-ac029fd31939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:30.495654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbb0f2-8f50-4adf-8ab6-ac029fd31939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:30.497742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbb0f2-8f50-4adf-8ab6-ac029fd31939 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:30.527262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1193/2375] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:30 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:33.630295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:33.691044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1d1a-fc7e-4453-845d-5f1ee00b69b3 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:33.695593 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:33.696477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:33.696752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:33.697019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] PATH_INFO: `/v3/users/eebbc8296429420e8dc27dcf4e942519` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:33.698245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebbc8296429420e8dc27dcf4e942519)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:33.700258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:33.748831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebbc8296429420e8dc27dcf4e942519'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:33.757845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebbc8296429420e8dc27dcf4e942519'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:33.766987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebbc8296429420e8dc27dcf4e942519'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:33.779033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebbc8296429420e8dc27dcf4e942519'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:33.779713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebbc8296429420e8dc27dcf4e942519'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:33.785511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1183/2376] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:33 2021] DELETE /identity/v3/users/eebbc8296429420e8dc27dcf4e942519 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:33.790103 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:33.791081 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:33.791376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:33.809186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:33.810620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:33.877146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1194/2377] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:33.887935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:33.889415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:33.953021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08fdc-c3a3-4b79-92c9-bad25a801c05 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:33.958823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:33.959484 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:33.960604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:33.960604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:33.979903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:33.981564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:33.997783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1184/2378] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:34.404301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:34.406010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:34.425767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b80044-af4b-49ed-b98c-9f9958ad9942 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:34.434596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:34.435828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:34.436355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:34.437334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] PATH_INFO: `/v3/projects/23d3eda90e624bce95e31b40a2a4a3f6` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:34.438911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d3eda90e624bce95e31b40a2a4a3f6)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:34.451609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:34.511436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d3eda90e624bce95e31b40a2a4a3f6', 'request_id': 'req-713d7dd1-f78d-4e42-969a-ef97e821582d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.518017 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d3eda90e624bce95e31b40a2a4a3f6', 'request_id': 'req-713d7dd1-f78d-4e42-969a-ef97e821582d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.525721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d3eda90e624bce95e31b40a2a4a3f6', 'request_id': 'req-713d7dd1-f78d-4e42-969a-ef97e821582d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.536232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] The token cache is being invalidate because project 23d3eda90e624bce95e31b40a2a4a3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:34.536513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.537120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.538694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1195/2379] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:34 2021] DELETE /identity/v3/projects/23d3eda90e624bce95e31b40a2a4a3f6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:34.542564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:34.551753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a6999-96bc-4fc7-a9a7-8cd1e1cd7d7c service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:34.607676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:34.608552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:34.608850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:34.609140 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] PATH_INFO: `/v3/users/d8e1364dd9224ffa92c488c07c6984e7` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:34.610309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e1364dd9224ffa92c488c07c6984e7)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:34.612258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:34.663541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e1364dd9224ffa92c488c07c6984e7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.673540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e1364dd9224ffa92c488c07c6984e7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.682305 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e1364dd9224ffa92c488c07c6984e7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.694868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e1364dd9224ffa92c488c07c6984e7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.695581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e1364dd9224ffa92c488c07c6984e7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:34.703250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1185/2380] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:34 2021] DELETE /identity/v3/users/d8e1364dd9224ffa92c488c07c6984e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:35.128095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.130888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:35.155899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d7dd1-f78d-4e42-969a-ef97e821582d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.253556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.254673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.255205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.255715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] PATH_INFO: `/v3/projects/f98089103e6b4cc8b8cad2ec28e7950c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.257235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98089103e6b4cc8b8cad2ec28e7950c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.257367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.259847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:35.260977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.275343 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0a8c-dc2d-478a-afdf-3ce7f5e9557e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.285395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.286497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.286942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.287227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] PATH_INFO: `/v3/users/c732ffe73d8d4746846af3fde1905134` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.288975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c732ffe73d8d4746846af3fde1905134)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.292506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.328713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98089103e6b4cc8b8cad2ec28e7950c', 'request_id': 'req-a635839b-2118-4872-b4cf-3302042d2f74'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.335303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98089103e6b4cc8b8cad2ec28e7950c', 'request_id': 'req-a635839b-2118-4872-b4cf-3302042d2f74'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.344660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98089103e6b4cc8b8cad2ec28e7950c', 'request_id': 'req-a635839b-2118-4872-b4cf-3302042d2f74'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.376037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] The token cache is being invalidate because project f98089103e6b4cc8b8cad2ec28e7950c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:35.376037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.377551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a635839b-2118-4872-b4cf-3302042d2f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.380506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1196/2381] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:35 2021] DELETE /identity/v3/projects/f98089103e6b4cc8b8cad2ec28e7950c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:35.386573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e463b-a6a2-4afb-80b0-bccc186d776f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.387941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e463b-a6a2-4afb-80b0-bccc186d776f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.388230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e463b-a6a2-4afb-80b0-bccc186d776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.401845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c732ffe73d8d4746846af3fde1905134'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.412142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c732ffe73d8d4746846af3fde1905134'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.420248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-081e463b-a6a2-4afb-80b0-bccc186d776f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:35.421830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-081e463b-a6a2-4afb-80b0-bccc186d776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:35.422356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c732ffe73d8d4746846af3fde1905134'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.439939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c732ffe73d8d4746846af3fde1905134'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.441001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a5cd4bbc-86a5-463e-b5bb-3d6447dd25d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c732ffe73d8d4746846af3fde1905134'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:35.447601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1186/2382] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:35 2021] DELETE /identity/v3/users/c732ffe73d8d4746846af3fde1905134 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:35.452029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.452316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.452590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.470285 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:35.471602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:35.493727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1197/2383] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:35.495717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.496004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.496335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.518385 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:35.519705 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:35.546256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1187/2384] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:35.556638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.559180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:35.594700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1198/2385] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:35.599175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.609130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ccb3f-e3af-41f9-bbe7-f6562437cf6b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.614463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.615171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.615410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.615656 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.616395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:35.616804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.619001 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.626310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8424e6f-cb23-42f7-9fef-1208cb3b7cac None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.630708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.630883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1199/2386] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:35.631706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.631706 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.631904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.634904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.642614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.644163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.645012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2c40-5aa5-4e95-93fc-40e7cca24309 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.649860 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.650545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.650875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.651094 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.651828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.653738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.654167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1188/2387] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:35.683825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1200/2388] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:35 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:35.684932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.694327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b734df-4e96-48a4-97a5-5e5afb6738f6 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.754739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.755903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.756188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.756827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.757315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.759915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.783081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1189/2389] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:35 2021] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:35.787333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.798672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca83b9d-a36a-4bae-a342-fda2117a3134 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.807068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.807780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.808533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.808533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.809038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.813139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.825811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1201/2390] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:35 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:35.829672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.840175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2b0fd-4666-43b6-b2f0-9e64c080833c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.853537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbaf3c-e00f-4872-91e9-1621dcf1fb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.854291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbaf3c-e00f-4872-91e9-1621dcf1fb6c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.854575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbaf3c-e00f-4872-91e9-1621dcf1fb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.854850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbaf3c-e00f-4872-91e9-1621dcf1fb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.855591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbaf3c-e00f-4872-91e9-1621dcf1fb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.857208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbaf3c-e00f-4872-91e9-1621dcf1fb6c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.872826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1190/2391] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:35 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:35.878285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:35.888602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a727a-59f7-47a1-9536-7019dbb4339a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:35.893269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:35.894190 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.894459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.894735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] PATH_INFO: `/v3/projects/c69b840793134f28adea458978251bdd/users/0f746e7117754434bccf37ae9fe502df/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.910035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69b840793134f28adea458978251bdd, user_id=0f746e7117754434bccf37ae9fe502df, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:35.912816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:35.928515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1202/2392] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:35 2021] PUT /identity/v3/projects/c69b840793134f28adea458978251bdd/users/0f746e7117754434bccf37ae9fe502df/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:35.939854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:35.940148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:35.940427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:35.967358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] MFA Rules not processed for user `0f746e7117754434bccf37ae9fe502df`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:35.968875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:36.068942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1191/2393] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:35 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:36.070101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.136127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283f47c-3d89-4df6-9294-d321e823562e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.142637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.143572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.143850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.144153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.144867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.146841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.178217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1203/2394] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:36 2021] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:36.185757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.198797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e1bc4-2e5f-4caf-b0d6-e3dd28fd0ac4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.204063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.206235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:36.358474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.359258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.359447 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.359723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.360445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.362440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.376169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaabed-18e0-4cf7-81ff-527c0ec67f88 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.395019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.397102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.397709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.398386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] PATH_INFO: `/v3/projects/f3d808af82ee464b8e50e66f15fd0a84` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.400628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d808af82ee464b8e50e66f15fd0a84)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.403965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.406693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1192/2395] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:36 2021] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:36.411408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.426105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b0ef-e8ff-4816-b44b-b3b001d20001 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.436156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.436841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.437120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.437393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.438172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.439808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.457877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1193/2396] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:36 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:36.458771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.473529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad4ab2-a03b-400e-b2ea-8d8637e230f6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.503010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d808af82ee464b8e50e66f15fd0a84', 'request_id': 'req-fdf35b15-d4b8-474f-a3d0-1d270a80e701'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:36.518612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d808af82ee464b8e50e66f15fd0a84', 'request_id': 'req-fdf35b15-d4b8-474f-a3d0-1d270a80e701'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:36.534995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d808af82ee464b8e50e66f15fd0a84', 'request_id': 'req-fdf35b15-d4b8-474f-a3d0-1d270a80e701'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:36.552339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] The token cache is being invalidate because project f3d808af82ee464b8e50e66f15fd0a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:36.552804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:36.553481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-fdf35b15-d4b8-474f-a3d0-1d270a80e701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:36.558371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1204/2397] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:36 2021] DELETE /identity/v3/projects/f3d808af82ee464b8e50e66f15fd0a84 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:36.561646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa737a-dce6-4441-8921-ad3edc17eb78 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.562129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa737a-dce6-4441-8921-ad3edc17eb78 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.562629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa737a-dce6-4441-8921-ad3edc17eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.577219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.578388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.578675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.578951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] PATH_INFO: `/v3/projects/7fcf582cab6041de9aa6923be1fb9502/users/dac683a9af62408eb4e3fe7fe5d0d734/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.590424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d4fa737a-dce6-4441-8921-ad3edc17eb78 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:36.591973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d4fa737a-dce6-4441-8921-ad3edc17eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:36.602475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1205/2398] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:36.612226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.612876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.613457 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.617635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcf582cab6041de9aa6923be1fb9502, user_id=dac683a9af62408eb4e3fe7fe5d0d734, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.621566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.642320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1194/2399] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:36 2021] PUT /identity/v3/projects/7fcf582cab6041de9aa6923be1fb9502/users/dac683a9af62408eb4e3fe7fe5d0d734/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:36.646633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:36.647988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:36.657289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.659361 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:36.737854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1206/2400] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:36.742138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.753740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c8db7-88a4-4f11-8860-3cd3f4b03f2b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.765465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.766359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.766761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.767793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.767933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:36.768297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.770059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.780705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217f70c-7992-4b77-b50c-00478e3d253c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.790054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.792019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.792635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.793134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.794340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.796661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1207/2401] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:09:36.797437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.801786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.815752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1195/2402] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:36 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:36.817701 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.818010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1c54-aca8-485f-a03d-c77d53e77d21 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.824107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.825029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.825733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.825733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.827085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.829495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.831300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c57d9-53db-4240-a1dc-7e3dfa3b1099 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.838930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.839829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.840111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.840388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] PATH_INFO: `/v3/projects/7fcf582cab6041de9aa6923be1fb9502/users/dac683a9af62408eb4e3fe7fe5d0d734/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.842508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcf582cab6041de9aa6923be1fb9502, user_id=dac683a9af62408eb4e3fe7fe5d0d734, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.845179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.869464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1208/2403] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:36 2021] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:36.871022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.872536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1196/2404] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:36 2021] PUT /identity/v3/projects/7fcf582cab6041de9aa6923be1fb9502/users/dac683a9af62408eb4e3fe7fe5d0d734/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:36.873731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:36.882215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:36.946071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae814d7d-557c-42af-b23e-b03ad7c5829f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.951506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.952403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.952678 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.952948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] PATH_INFO: `/v3/users/dcc76cb4eb2843c9af7299c422400125` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.954221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc76cb4eb2843c9af7299c422400125)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.956323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:36.959185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b990c2-24dc-4e83-b9eb-43e26549acdf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:36.972430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfcccf-5bdd-46e9-8274-787b7190b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:36.973162 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcccf-5bdd-46e9-8274-787b7190b8ca admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:36.973443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcccf-5bdd-46e9-8274-787b7190b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:36.973721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfcccf-5bdd-46e9-8274-787b7190b8ca admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:36.974588 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfcccf-5bdd-46e9-8274-787b7190b8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:36.976799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfcccf-5bdd-46e9-8274-787b7190b8ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.006239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1197/2405] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:36 2021] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:37.006239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.006239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.006239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.016060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc76cb4eb2843c9af7299c422400125'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.025060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc76cb4eb2843c9af7299c422400125'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.035455 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] MFA Rules not processed for user `dac683a9af62408eb4e3fe7fe5d0d734`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:37.036939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.039253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc76cb4eb2843c9af7299c422400125'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.040647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc76cb4eb2843c9af7299c422400125'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.052471 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc76cb4eb2843c9af7299c422400125'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.058984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1209/2406] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:36 2021] DELETE /identity/v3/users/dcc76cb4eb2843c9af7299c422400125 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:37.059837 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.061121 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.113063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1198/2407] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:37 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:37.114119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.117550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.132151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ea34b-5a22-4fea-aad1-543d70601a78 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.144796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa301-23ab-4bc6-9c8d-463c3a18abd6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.151499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.152178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.152465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.152740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.154577 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.167717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.169499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.181605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1210/2408] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:37.182220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.183603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.193235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.193904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.194209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.194486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.195723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.197851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.213675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1199/2409] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:37.214617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.229749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d2c1-69f0-436e-908f-4544964bd3d5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.236400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.237260 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.237532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.237822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.238678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.239739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3605a-8c34-4b82-8c9f-7c0914a4b219 service nova] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.240289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.244450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.245113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.245421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.245698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.254836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1200/2410] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:37.259539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.272816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b2b09-47eb-4b88-a9da-dea75edd3bc2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.282797 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458722f2-30a2-4cf9-89f5-69f37f39f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.284650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458722f2-30a2-4cf9-89f5-69f37f39f67b admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.285213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458722f2-30a2-4cf9-89f5-69f37f39f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.285564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458722f2-30a2-4cf9-89f5-69f37f39f67b admin admin] PATH_INFO: `/v3/projects/7167a3b52fca4b349e5984d0e9600020/users/5941feda0eca4bcfb389fe0ab3c157f3/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.318673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.320224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.320491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458722f2-30a2-4cf9-89f5-69f37f39f67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7167a3b52fca4b349e5984d0e9600020, user_id=5941feda0eca4bcfb389fe0ab3c157f3, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.323435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458722f2-30a2-4cf9-89f5-69f37f39f67b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.332789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1211/2411] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:37.333441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.335474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.344345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1201/2412] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:37 2021] PUT /identity/v3/projects/7167a3b52fca4b349e5984d0e9600020/users/5941feda0eca4bcfb389fe0ab3c157f3/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:37.351441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf200-aeec-401f-a942-27464544e427 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.355800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967138c-b374-4514-893c-1c10b2b677da None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.356159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967138c-b374-4514-893c-1c10b2b677da None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.356366 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967138c-b374-4514-893c-1c10b2b677da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.390391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a967138c-b374-4514-893c-1c10b2b677da None None] MFA Rules not processed for user `5941feda0eca4bcfb389fe0ab3c157f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:37.392017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a967138c-b374-4514-893c-1c10b2b677da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.425703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.426621 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.426934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.427173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] PATH_INFO: `/v3/projects/c78a2fc93eea4d85bd4d547d653dc2b0` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.428443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78a2fc93eea4d85bd4d547d653dc2b0)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.430490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.460299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1202/2413] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:37 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:37.461385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967138c-b374-4514-893c-1c10b2b677da None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.465302 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a967138c-b374-4514-893c-1c10b2b677da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.485567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'request_id': 'req-e4ad148c-a45a-4892-9681-b5068e6c0716'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.491586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'request_id': 'req-e4ad148c-a45a-4892-9681-b5068e6c0716'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.500198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78a2fc93eea4d85bd4d547d653dc2b0', 'request_id': 'req-e4ad148c-a45a-4892-9681-b5068e6c0716'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.511263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] The token cache is being invalidate because project c78a2fc93eea4d85bd4d547d653dc2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:37.511891 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.512531 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.514089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1212/2414] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:37 2021] DELETE /identity/v3/projects/c78a2fc93eea4d85bd4d547d653dc2b0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:37.514947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.516242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.522769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967138c-b374-4514-893c-1c10b2b677da None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.570804 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.572020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.572303 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.572577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.574462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.579096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad148c-a45a-4892-9681-b5068e6c0716 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.585218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.585877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.586184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.586461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.587208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.589142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.620855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1213/2415] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:37 2021] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:37.620855 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.623937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.643222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.644885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.654508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1203/2416] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:37.655251 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.665673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9bc4c-9b77-4881-9c81-c158e9ef9d05 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.704082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df21de-23cf-4d8d-b46a-7f95944ad725 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.717289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.718797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.719156 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.723590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] PATH_INFO: `/v3/users/1f8391b954b4484c993c0211ea4a8e29` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.725073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8391b954b4484c993c0211ea4a8e29)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.727227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.752407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.752407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.752407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.752407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.753013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.753013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.777211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1204/2417] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:37 2021] POST /identity/v3/users => generated 309 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:37.778590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.790500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249429e-97f8-43cc-ab34-94bb2a4bc049 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.793232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8391b954b4484c993c0211ea4a8e29'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.796241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.796913 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.797189 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.797463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.798275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.799948 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.801830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8391b954b4484c993c0211ea4a8e29'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.811539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1205/2418] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:37.815275 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.823427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8391b954b4484c993c0211ea4a8e29'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.824192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8391b954b4484c993c0211ea4a8e29'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.826749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389f893-354c-4d96-8ae7-bdf595187661 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:37.832768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:37.833961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:37.839525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8391b954b4484c993c0211ea4a8e29'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:37.839669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:37.839898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] PATH_INFO: `/v3/projects/b06ed0ef43ec458ab54d0f901adaf014/users/eff4654b69194aea9dc8a6944b972e5f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:37.847100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1214/2419] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:37 2021] DELETE /identity/v3/users/1f8391b954b4484c993c0211ea4a8e29 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:37.861940 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06ed0ef43ec458ab54d0f901adaf014, user_id=eff4654b69194aea9dc8a6944b972e5f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:37.864624 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:37.880031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1206/2420] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:37 2021] PUT /identity/v3/projects/b06ed0ef43ec458ab54d0f901adaf014/users/eff4654b69194aea9dc8a6944b972e5f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:37.884407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:37.886958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:37.973418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a1174-abd8-437d-a9c8-316e673e76dc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:38.057900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:38.060073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.096316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:38.097021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.097425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.097717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.098929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:38.100501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:38.111897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1215/2421] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:38.116034 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:38.126491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1263e-3396-42f2-b9c6-b03936f967bf admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:38.131152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee930f43-2642-4b7c-8e9b-2500130a8546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:38.132016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee930f43-2642-4b7c-8e9b-2500130a8546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.132293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee930f43-2642-4b7c-8e9b-2500130a8546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.132563 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee930f43-2642-4b7c-8e9b-2500130a8546 admin admin] PATH_INFO: `/v3/projects/b06ed0ef43ec458ab54d0f901adaf014/users/eff4654b69194aea9dc8a6944b972e5f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.134558 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee930f43-2642-4b7c-8e9b-2500130a8546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06ed0ef43ec458ab54d0f901adaf014, user_id=eff4654b69194aea9dc8a6944b972e5f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:38.137446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee930f43-2642-4b7c-8e9b-2500130a8546 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:38.141435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649f5f9-1230-45f5-9a7a-48208f86edb0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:38.147323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1216/2422] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:38 2021] PUT /identity/v3/projects/b06ed0ef43ec458ab54d0f901adaf014/users/eff4654b69194aea9dc8a6944b972e5f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:38.159382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.159665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.159938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.185886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] MFA Rules not processed for user `eff4654b69194aea9dc8a6944b972e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:38.187118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.196488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:38.197338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.197621 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.197898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] PATH_INFO: `/v3/projects/4609584d1a7344b49813a80ea3fbc26b` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.199213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4609584d1a7344b49813a80ea3fbc26b)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:38.201105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:38.245440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4609584d1a7344b49813a80ea3fbc26b', 'request_id': 'req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.251307 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4609584d1a7344b49813a80ea3fbc26b', 'request_id': 'req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.253080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1217/2423] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:38 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:38.258756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4609584d1a7344b49813a80ea3fbc26b', 'request_id': 'req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.263315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:38.264695 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.269177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] The token cache is being invalidate because project 4609584d1a7344b49813a80ea3fbc26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:38.269487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.270119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.271677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1207/2424] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:38 2021] DELETE /identity/v3/projects/4609584d1a7344b49813a80ea3fbc26b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:38.326929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d93134-1690-4ccc-93c8-6b8c62b3c439 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:38.380132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:38.380933 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.381373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.381658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.383748 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.458931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:38.460427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f3c2f-0eb8-4874-9dce-5542ad3a99c1 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:38.471571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1218/2425] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:38 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:38.599298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:38.600759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.663314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0cb61-b86e-46d6-aeb9-b89379ee24ea admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:38.667869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:38.668749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.669033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.669304 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] PATH_INFO: `/v3/users/5941feda0eca4bcfb389fe0ab3c157f3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.670542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5941feda0eca4bcfb389fe0ab3c157f3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:38.672483 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:38.716463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5941feda0eca4bcfb389fe0ab3c157f3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.723245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5941feda0eca4bcfb389fe0ab3c157f3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.729684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5941feda0eca4bcfb389fe0ab3c157f3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.740538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5941feda0eca4bcfb389fe0ab3c157f3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.741154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5941feda0eca4bcfb389fe0ab3c157f3'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:38.746816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1208/2426] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:38 2021] DELETE /identity/v3/users/5941feda0eca4bcfb389fe0ab3c157f3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:38.751519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.751749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.752021 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.769942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:38.771179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.831074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1219/2427] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:38.841478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:38.843310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:38.911023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d430811-6f96-4532-a467-77c32021d0a3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:38.915611 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:38.916259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:38.916536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:38.916809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:38.925973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:38.927429 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:38.937198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1209/2428] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:39.505587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:39.507132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:39.519319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f992-f049-4569-b69b-0eff6b532339 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:39.527260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:39.528195 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:39.528479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:39.528744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] PATH_INFO: `/v3/projects/7167a3b52fca4b349e5984d0e9600020` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:39.529993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7167a3b52fca4b349e5984d0e9600020)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:39.532132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:39.581408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7167a3b52fca4b349e5984d0e9600020', 'request_id': 'req-4040a3e3-41c5-4f33-80b3-08ec841b98e1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.588888 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7167a3b52fca4b349e5984d0e9600020', 'request_id': 'req-4040a3e3-41c5-4f33-80b3-08ec841b98e1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.598345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7167a3b52fca4b349e5984d0e9600020', 'request_id': 'req-4040a3e3-41c5-4f33-80b3-08ec841b98e1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.609603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] The token cache is being invalidate because project 7167a3b52fca4b349e5984d0e9600020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:39.609890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.610594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.612223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1220/2429] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:39 2021] DELETE /identity/v3/projects/7167a3b52fca4b349e5984d0e9600020 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:39.616513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:39.626286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e74ea7-3b90-4399-9e6a-199ef9cdd690 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:39.684799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:39.685850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:39.686133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:39.686437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] PATH_INFO: `/v3/users/eff4654b69194aea9dc8a6944b972e5f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:39.687681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff4654b69194aea9dc8a6944b972e5f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:39.689645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:39.739327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff4654b69194aea9dc8a6944b972e5f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.747539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff4654b69194aea9dc8a6944b972e5f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.754830 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff4654b69194aea9dc8a6944b972e5f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.767414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff4654b69194aea9dc8a6944b972e5f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.768141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fecd3c81-ef4d-40db-b789-7cbfcddd5a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff4654b69194aea9dc8a6944b972e5f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:39.773967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1210/2430] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:39 2021] DELETE /identity/v3/users/eff4654b69194aea9dc8a6944b972e5f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:40.067585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.069120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:40.086174 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040a3e3-41c5-4f33-80b3-08ec841b98e1 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.145313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.146177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.146461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.146736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] PATH_INFO: `/v3/projects/b06ed0ef43ec458ab54d0f901adaf014` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.147999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06ed0ef43ec458ab54d0f901adaf014)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.149962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.196506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06ed0ef43ec458ab54d0f901adaf014', 'request_id': 'req-b7b506d9-0b11-45d3-aecb-68f5756e9403'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:40.202478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06ed0ef43ec458ab54d0f901adaf014', 'request_id': 'req-b7b506d9-0b11-45d3-aecb-68f5756e9403'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:40.210175 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06ed0ef43ec458ab54d0f901adaf014', 'request_id': 'req-b7b506d9-0b11-45d3-aecb-68f5756e9403'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:40.221263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] The token cache is being invalidate because project b06ed0ef43ec458ab54d0f901adaf014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:40.221542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:40.222478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-b7b506d9-0b11-45d3-aecb-68f5756e9403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:40.224187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1221/2431] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:40 2021] DELETE /identity/v3/projects/b06ed0ef43ec458ab54d0f901adaf014 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:40.230410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.230950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.230950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.249801 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:40.251075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:40.313108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1211/2432] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:40.321157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.321537 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.321884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.344562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:40.345796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:40.354963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1222/2433] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:40.359186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.370295 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e154533-c8a8-4c82-8cb5-b8f86200686f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.375616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.376299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.376582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.376857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.377620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:40.377941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.379610 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.397672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1212/2434] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:40.399809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.403268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.406101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:40.412224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a993c3-2b58-423b-95c7-ae13e781f13b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.418000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.418732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.419019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.419312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.420399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.422168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.459353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1223/2435] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:40 2021] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:40.466525 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.499802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af8aa7-1cc1-4704-9143-16768fec7849 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.561951 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cc661-8ba0-410e-a7e7-bbb3a4e0b682 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.568514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.569205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.569671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.570176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.571443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.574756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.590795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.591808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.593491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.593821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.598745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:40.612668 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1224/2436] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:40 2021] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:40.615470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.620496 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.622454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.627617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbefad-cf6d-4244-927f-fc68bdf73afe admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.635000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.636396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.636941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.637321 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.638306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.640170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.645682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1213/2437] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:40.652591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1225/2438] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:40.656324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.667595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1e339-d1b1-4d66-b0ba-55bf12e8bbf6 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.672723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079d16-06e7-4c58-97ae-20946307131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.673314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079d16-06e7-4c58-97ae-20946307131d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.673595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079d16-06e7-4c58-97ae-20946307131d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.673867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079d16-06e7-4c58-97ae-20946307131d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.676070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079d16-06e7-4c58-97ae-20946307131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.677884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079d16-06e7-4c58-97ae-20946307131d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.694327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1214/2439] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:40.695444 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:40.711089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b27ec-eb6c-4fb9-b885-487cea94a632 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:40.716657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:40.717847 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.718269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.718650 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] PATH_INFO: `/v3/projects/d59994ef95c54ecfb8d610b479cce7c2/users/50c7b73ff0284787b7e980758130ff08/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.738284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59994ef95c54ecfb8d610b479cce7c2, user_id=50c7b73ff0284787b7e980758130ff08, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:40.741522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:40.764102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1226/2440] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:40 2021] PUT /identity/v3/projects/d59994ef95c54ecfb8d610b479cce7c2/users/50c7b73ff0284787b7e980758130ff08/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:40.779227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d835914-0577-4632-9952-71a4149ebfec None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:40.779565 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d835914-0577-4632-9952-71a4149ebfec None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:40.779930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d835914-0577-4632-9952-71a4149ebfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:40.822772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1d835914-0577-4632-9952-71a4149ebfec None None] MFA Rules not processed for user `50c7b73ff0284787b7e980758130ff08`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:40.824111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1d835914-0577-4632-9952-71a4149ebfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:40.933222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1215/2441] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:40.937713 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.014743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2381fa-d068-402b-9006-e2430eb8b60a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.020305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.020963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.021242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.021515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.022353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.024908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.056258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1227/2442] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:40 2021] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:41.062612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d835914-0577-4632-9952-71a4149ebfec None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.088658 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d835914-0577-4632-9952-71a4149ebfec None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.179638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.184399 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.185191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.185644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.187598 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.191910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.195302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.197842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.213371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc607-483a-4a3c-9713-2661e3db5b40 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.219589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.220337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1216/2443] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:41 2021] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:41.221077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.221272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.222006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.222544 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] PATH_INFO: `/v3/users/0f746e7117754434bccf37ae9fe502df` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.223872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f746e7117754434bccf37ae9fe502df)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.225817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.232675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8388a-c1f8-47b2-8867-698faacab51d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.238174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.238498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.238874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.239245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.240078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.242205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.254738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1217/2444] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:41.260427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.273210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299c3fc-df58-499e-92f0-fdb61979c9b0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.278343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f746e7117754434bccf37ae9fe502df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.278927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.279962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.280340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.280737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] PATH_INFO: `/v3/projects/e4922968ed0f478f9de545a7b3ae4ff3/users/17db27aa08374d00baee7bb2d33eaebf/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.288192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f746e7117754434bccf37ae9fe502df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.302741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f746e7117754434bccf37ae9fe502df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.304954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f746e7117754434bccf37ae9fe502df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.313917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4922968ed0f478f9de545a7b3ae4ff3, user_id=17db27aa08374d00baee7bb2d33eaebf, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.316715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.333167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ab91d33f-c9bc-433c-8a53-77dafe7ae6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f746e7117754434bccf37ae9fe502df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.335614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1218/2445] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:41 2021] PUT /identity/v3/projects/e4922968ed0f478f9de545a7b3ae4ff3/users/17db27aa08374d00baee7bb2d33eaebf/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:41.339514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.341748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.342627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1228/2446] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:41 2021] DELETE /identity/v3/users/0f746e7117754434bccf37ae9fe502df => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:41.347122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.347401 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.347674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.369333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:41.370609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.422772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc88f6-77f9-4e64-a1fc-16ead90a410d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.437913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1229/2447] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:41.448774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.450314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.480914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.481575 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.481854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.482545 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.482898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.484707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.500181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1219/2448] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:41 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:41.502518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.518436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed815c3-5e51-49ef-b11a-88d2541fc581 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.522495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9df57b-239e-4a7f-bd52-99827b915384 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.524822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d40b9-134e-4c50-b340-0c78959497de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.525908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d40b9-134e-4c50-b340-0c78959497de admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.526489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d40b9-134e-4c50-b340-0c78959497de admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.526902 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d40b9-134e-4c50-b340-0c78959497de admin admin] PATH_INFO: `/v3/projects/e4922968ed0f478f9de545a7b3ae4ff3/users/17db27aa08374d00baee7bb2d33eaebf/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.527834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.528630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.529029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d40b9-134e-4c50-b340-0c78959497de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4922968ed0f478f9de545a7b3ae4ff3, user_id=17db27aa08374d00baee7bb2d33eaebf, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.529212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.529572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.532089 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d40b9-134e-4c50-b340-0c78959497de admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.544328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.545159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1220/2449] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:41 2021] PUT /identity/v3/projects/e4922968ed0f478f9de545a7b3ae4ff3/users/17db27aa08374d00baee7bb2d33eaebf/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:41.546832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.557754 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.558083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.558348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.564670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1230/2450] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:41.596984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] MFA Rules not processed for user `17db27aa08374d00baee7bb2d33eaebf`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:41.598229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.685123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1221/2451] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:41 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:41.697402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.699389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.776158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef03e-1a85-4cdd-848a-2098ca9dbd2e service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.841279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.841279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.841279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.841279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.852738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.854215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.860498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.862034 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.868804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1231/2452] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:41 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:41.922458 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:41.923864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.934783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc59096-ca3b-4432-9815-6992deee9929 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.935899 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec8a7f-f325-45c7-b372-5fbb37c000e1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:41.938579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.939210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.939491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.939783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.941237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:41.941510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:41.942079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:41.942471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:41.942741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] PATH_INFO: `/v3/projects/c69b840793134f28adea458978251bdd` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:41.943922 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69b840793134f28adea458978251bdd)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:41.945839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:41.991884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69b840793134f28adea458978251bdd', 'request_id': 'req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.997880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69b840793134f28adea458978251bdd', 'request_id': 'req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:41.999527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.000962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.005329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69b840793134f28adea458978251bdd', 'request_id': 'req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.010961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1232/2453] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:41 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:42.017488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] The token cache is being invalidate because project c69b840793134f28adea458978251bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:42.017891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.018603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.020156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1222/2454] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:41 2021] DELETE /identity/v3/projects/c69b840793134f28adea458978251bdd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:42.024773 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.034902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59998a71-4060-49f5-9b12-07d68ca9c54d service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.089117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.089909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.090218 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.090492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] PATH_INFO: `/v3/users/dac683a9af62408eb4e3fe7fe5d0d734` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.091715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac683a9af62408eb4e3fe7fe5d0d734)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.093617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.138890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac683a9af62408eb4e3fe7fe5d0d734'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.145570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac683a9af62408eb4e3fe7fe5d0d734'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.153677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac683a9af62408eb4e3fe7fe5d0d734'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.154505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac683a9af62408eb4e3fe7fe5d0d734'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.167208 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-73495842-5cfc-4616-bcc1-4738382f0dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac683a9af62408eb4e3fe7fe5d0d734'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.176414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1233/2455] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:42 2021] DELETE /identity/v3/users/dac683a9af62408eb4e3fe7fe5d0d734 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:42.464178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.465609 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:42.480590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b644f-7006-4f21-8a3b-84c0f5ce86ca admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.536876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.537721 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.538003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.538306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] PATH_INFO: `/v3/projects/7fcf582cab6041de9aa6923be1fb9502` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.539517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcf582cab6041de9aa6923be1fb9502)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.541395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.585371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcf582cab6041de9aa6923be1fb9502', 'request_id': 'req-9f052716-99db-43c5-a9eb-98b9990d7f47'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.591980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcf582cab6041de9aa6923be1fb9502', 'request_id': 'req-9f052716-99db-43c5-a9eb-98b9990d7f47'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.599623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcf582cab6041de9aa6923be1fb9502', 'request_id': 'req-9f052716-99db-43c5-a9eb-98b9990d7f47'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.609375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] The token cache is being invalidate because project 7fcf582cab6041de9aa6923be1fb9502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:42.609656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.610318 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9f052716-99db-43c5-a9eb-98b9990d7f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:42.612038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1223/2456] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:42 2021] DELETE /identity/v3/projects/7fcf582cab6041de9aa6923be1fb9502 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:42.617943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.618516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.618818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.638694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:42.639877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:42.704844 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1234/2457] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:42.712616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.712901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.713171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.730974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:42.732176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:42.739953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1224/2458] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:42.744486 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.753781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f992b-19c7-47c6-ab60-822d797c5aba None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.758881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.759515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.759791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.760059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.760781 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:42.761080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.762943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.773843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1235/2459] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:42.777850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.786869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272c92-53ed-4ccc-9979-543c7f3f7691 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.791477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.792108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.792385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.792657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.793354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.795259 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.820373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1225/2460] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:42 2021] POST /identity/v3/projects => generated 407 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:42.825181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.834899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672ad4-5f65-4a1a-bfc1-0bd936a4e58c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.888204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.888943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.889184 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.889539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.890367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.892272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.912902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1236/2461] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:42 2021] POST /identity/v3/users => generated 304 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:42.917072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.927200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30bed-8d87-4279-96fe-44b5258c4f40 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.932272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.932917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.933214 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.933470 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.934290 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.935877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.946542 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1226/2462] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:42.950455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.960083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16da7ad-46dc-435b-8566-8b3a237f941c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.964659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6561eb1-a5a4-408b-876a-85711339eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.965297 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561eb1-a5a4-408b-876a-85711339eb89 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.965574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561eb1-a5a4-408b-876a-85711339eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.965846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6561eb1-a5a4-408b-876a-85711339eb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:42.966718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6561eb1-a5a4-408b-876a-85711339eb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:42.968288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6561eb1-a5a4-408b-876a-85711339eb89 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:42.977734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1237/2463] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:42.981493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:42.991244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823db7-231b-4858-810f-686e757e0e91 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:42.996359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:42.997210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:42.997491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:42.997787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] PATH_INFO: `/v3/projects/8761219c11e24c4eb2337eee2e0ed3f1/users/001422d6bd7940a2904224fca6115dcb/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.012758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8761219c11e24c4eb2337eee2e0ed3f1, user_id=001422d6bd7940a2904224fca6115dcb, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.015425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.027380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1227/2464] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:42 2021] PUT /identity/v3/projects/8761219c11e24c4eb2337eee2e0ed3f1/users/001422d6bd7940a2904224fca6115dcb/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:43.038397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.038686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.038964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.065044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] MFA Rules not processed for user `001422d6bd7940a2904224fca6115dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:43.066260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:43.125209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1238/2465] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:43 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:43.129945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.187821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abeaa0-436c-40f5-9531-b80ddfadc80a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.192517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.193160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.193437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.193714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.194446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.196376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.219582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1228/2466] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:43 2021] POST /identity/v3/projects => generated 407 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:43.223574 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.234487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04241bc9-cde3-4013-b556-ee38c2b01378 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.288692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.289872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.290224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.290495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.291199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.293236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.323180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1239/2467] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:43 2021] POST /identity/v3/users => generated 310 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:43.324518 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.334868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e6d85-3e7c-4775-a970-b532b5a3e677 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.339734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.340451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.340733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.341005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.341734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.344520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.362039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1229/2468] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:43.363743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.374339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33a74f-e68a-4c2a-960c-ab8f8d8f08c2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.379054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.379922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.380204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.380478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] PATH_INFO: `/v3/projects/2d7da3a7b038450f9f7914a1c283accd/users/3869ee2766cc4c56913c7affa6de8933/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.396211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7da3a7b038450f9f7914a1c283accd, user_id=3869ee2766cc4c56913c7affa6de8933, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.400070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.412529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1240/2469] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:43 2021] PUT /identity/v3/projects/2d7da3a7b038450f9f7914a1c283accd/users/3869ee2766cc4c56913c7affa6de8933/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:43.417052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.427239 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6823ee-d13e-4c03-b08b-d08b6ff255dc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.481451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca87e-0a11-41fb-a7a9-f3b4e156c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.482116 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca87e-0a11-41fb-a7a9-f3b4e156c59c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.482423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca87e-0a11-41fb-a7a9-f3b4e156c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.482696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca87e-0a11-41fb-a7a9-f3b4e156c59c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.483538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bca87e-0a11-41fb-a7a9-f3b4e156c59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.485123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bca87e-0a11-41fb-a7a9-f3b4e156c59c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.495030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1230/2470] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:43 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:43.499151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.509451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d090a4-676d-427b-8358-6d0c6b758f45 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.514417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.515286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.515567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.515842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] PATH_INFO: `/v3/projects/2d7da3a7b038450f9f7914a1c283accd/users/3869ee2766cc4c56913c7affa6de8933/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.517843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7da3a7b038450f9f7914a1c283accd, user_id=3869ee2766cc4c56913c7affa6de8933, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.520539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.531384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1241/2471] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:43 2021] PUT /identity/v3/projects/2d7da3a7b038450f9f7914a1c283accd/users/3869ee2766cc4c56913c7affa6de8933/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:43.542074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.542400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.542682 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.568868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] MFA Rules not processed for user `3869ee2766cc4c56913c7affa6de8933`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:43.570125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:43.637530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1231/2472] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:43 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:43.647403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.649652 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:43.711688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b67ba-7756-40e9-9e98-b4c150ecf768 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.715818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.716502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.716955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.717380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.728684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.730535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.741402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1242/2473] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:43 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:43.896909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:43.910103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886e6a-a96e-4cee-84ae-73becf7385d7 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:43.914816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24603cb-e4e8-4825-8fd5-456fb43d6041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:43.915465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24603cb-e4e8-4825-8fd5-456fb43d6041 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:43.915746 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24603cb-e4e8-4825-8fd5-456fb43d6041 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:43.916020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24603cb-e4e8-4825-8fd5-456fb43d6041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:43.981430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24603cb-e4e8-4825-8fd5-456fb43d6041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:43.982915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24603cb-e4e8-4825-8fd5-456fb43d6041 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:43.992301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1232/2474] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:43 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:45.219674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:45.221062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:45.283172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0aa0-b564-4dd5-b808-ebf6630da42e service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:45.287947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:45.288806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:45.289087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:45.289390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] PATH_INFO: `/v3/users/50c7b73ff0284787b7e980758130ff08` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:45.290672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c7b73ff0284787b7e980758130ff08)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:45.293015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:45.345201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c7b73ff0284787b7e980758130ff08'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.353159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c7b73ff0284787b7e980758130ff08'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.360918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c7b73ff0284787b7e980758130ff08'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.361635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c7b73ff0284787b7e980758130ff08'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.374353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c7b73ff0284787b7e980758130ff08'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.381322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1243/2475] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:45 2021] DELETE /identity/v3/users/50c7b73ff0284787b7e980758130ff08 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:45.386792 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:45.387294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:45.387615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:45.406983 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:45.408234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:45.471070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1233/2476] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:45.483510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:45.485146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:45.545168 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452ab87-1410-4a33-bda3-aa2291b392c4 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:45.548776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:45.549406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:45.549687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:45.549959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:45.558696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:45.560126 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:45.569661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1244/2477] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:45.822869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:45.824360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:45.836800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95affd3-e356-42ff-b854-1fd5675efec0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:45.841738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:45.842634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:45.842919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:45.843224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] PATH_INFO: `/v3/projects/d59994ef95c54ecfb8d610b479cce7c2` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:45.844433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59994ef95c54ecfb8d610b479cce7c2)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:45.846376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:45.892674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59994ef95c54ecfb8d610b479cce7c2', 'request_id': 'req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.898580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59994ef95c54ecfb8d610b479cce7c2', 'request_id': 'req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.905740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59994ef95c54ecfb8d610b479cce7c2', 'request_id': 'req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.915510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] The token cache is being invalidate because project d59994ef95c54ecfb8d610b479cce7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:45.915790 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.916410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:45.917929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1234/2478] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:45 2021] DELETE /identity/v3/projects/d59994ef95c54ecfb8d610b479cce7c2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:45.922306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:45.932327 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4620d2-b511-4f3b-a614-335dfd65e964 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:45.989060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:45.989920 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:45.990238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:45.990517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] PATH_INFO: `/v3/users/17db27aa08374d00baee7bb2d33eaebf` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:45.991818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17db27aa08374d00baee7bb2d33eaebf)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:45.994320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.041849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17db27aa08374d00baee7bb2d33eaebf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.048817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17db27aa08374d00baee7bb2d33eaebf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.055934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17db27aa08374d00baee7bb2d33eaebf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.056562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17db27aa08374d00baee7bb2d33eaebf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.067494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-322a1196-a2c2-4f56-bb18-292703831e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17db27aa08374d00baee7bb2d33eaebf'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.073232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1245/2479] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:45 2021] DELETE /identity/v3/users/17db27aa08374d00baee7bb2d33eaebf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:46.330197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.331631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:46.345842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dea9a-c700-4eba-9f4d-d43e0f2efd35 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.403012 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.403854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.404125 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.404390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] PATH_INFO: `/v3/projects/e4922968ed0f478f9de545a7b3ae4ff3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.405548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4922968ed0f478f9de545a7b3ae4ff3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.407456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.450133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4922968ed0f478f9de545a7b3ae4ff3', 'request_id': 'req-257ac3f8-9a12-40a0-a5b3-ade26d700912'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.455898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4922968ed0f478f9de545a7b3ae4ff3', 'request_id': 'req-257ac3f8-9a12-40a0-a5b3-ade26d700912'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.463112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4922968ed0f478f9de545a7b3ae4ff3', 'request_id': 'req-257ac3f8-9a12-40a0-a5b3-ade26d700912'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.472676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] The token cache is being invalidate because project e4922968ed0f478f9de545a7b3ae4ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:46.472952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.473558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-257ac3f8-9a12-40a0-a5b3-ade26d700912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:46.475074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1235/2480] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:46 2021] DELETE /identity/v3/projects/e4922968ed0f478f9de545a7b3ae4ff3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:46.481429 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.481919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.482323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.500011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:46.501215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:46.558366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1246/2481] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:46.566043 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.566519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.566799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.584761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:46.586482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:46.594437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1236/2482] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:46.598875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.609079 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf12cc-295d-44f7-ba51-50ed68244361 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.613832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.614527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.614810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.615086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.615831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:46.616135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.617710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.629036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1247/2483] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:46.633332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.642604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60283347-ed78-4e45-a30e-eb16bb0e17aa None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.647234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.647872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.648149 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.648917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.649616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.651568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.677170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1237/2484] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:46 2021] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:46.681359 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.691535 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fa25c-8ac5-44da-8313-7492eeaa694e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.744952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.745625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.745901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.746194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.746943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.748832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.769660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1248/2485] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:46 2021] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:46.774424 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.784181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe70413-9ec8-4d6e-a26b-3e67a169e778 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.788833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.789585 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.789868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.790137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.790905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.793475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.804069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1238/2486] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:46.808393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.818330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d59ab-d367-44ba-878e-8b9ae569255d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.823407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0473ef-530b-4666-87f7-351d82307aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.824052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0473ef-530b-4666-87f7-351d82307aad admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.824328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0473ef-530b-4666-87f7-351d82307aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.824598 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0473ef-530b-4666-87f7-351d82307aad admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.825324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0473ef-530b-4666-87f7-351d82307aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.826994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0473ef-530b-4666-87f7-351d82307aad admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.836969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1249/2487] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:46 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:46.840914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:46.850577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2fbe-4367-4938-af38-b23a1b445bca admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:46.855064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:46.855915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.856192 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.856460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] PATH_INFO: `/v3/projects/06ad2ab296e6474db6f30fd810006ed3/users/b808c4b837ae447281660cdc05fd104d/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.870509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ad2ab296e6474db6f30fd810006ed3, user_id=b808c4b837ae447281660cdc05fd104d, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:46.873119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:46.885898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1239/2488] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:46 2021] PUT /identity/v3/projects/06ad2ab296e6474db6f30fd810006ed3/users/b808c4b837ae447281660cdc05fd104d/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:46.896305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:46.896594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:46.896865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:46.922790 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] MFA Rules not processed for user `b808c4b837ae447281660cdc05fd104d`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:46.923979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:46.984515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1250/2489] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:46 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:46.989086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.047757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c5ae-06a7-4bbf-b54e-d988979eb2cf admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.052300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.053048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.053331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.053602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.054316 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.056190 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.080153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1240/2490] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:46 2021] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:47.084024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.095002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a07299-4c83-4dc9-8b15-b64ce15ab123 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.147146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.147997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.148276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.149143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.149841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.151769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.171080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1251/2491] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:47 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:47.175002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.185296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12183522-c9cb-4ece-9508-5f4fb20a338e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.189919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.190615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.190893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.191166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.191915 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.193480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.204274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1241/2492] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:47.209263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.221909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbd5b6-9959-4a88-8025-86893f68970b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.226464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.227346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.227623 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.227894 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] PATH_INFO: `/v3/projects/e1f5a26c83914c96a038a67537039258/users/649cc31d1202457297fe64996e09fb87/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.241768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f5a26c83914c96a038a67537039258, user_id=649cc31d1202457297fe64996e09fb87, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.244918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.256919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1252/2493] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:47 2021] PUT /identity/v3/projects/e1f5a26c83914c96a038a67537039258/users/649cc31d1202457297fe64996e09fb87/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:47.261698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.271744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07065-5650-4f58-ad32-beb6d6e16194 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.326448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cead767-ddf9-4a99-8b31-60902f9344dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.327096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cead767-ddf9-4a99-8b31-60902f9344dd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.327376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cead767-ddf9-4a99-8b31-60902f9344dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.327671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cead767-ddf9-4a99-8b31-60902f9344dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.328390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cead767-ddf9-4a99-8b31-60902f9344dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.329961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cead767-ddf9-4a99-8b31-60902f9344dd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.339284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1242/2494] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:47 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:47.343340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.353410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeac053-82c9-4687-84e2-e39882c4de47 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.357941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.358836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.359116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.359386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] PATH_INFO: `/v3/projects/e1f5a26c83914c96a038a67537039258/users/649cc31d1202457297fe64996e09fb87/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.361515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f5a26c83914c96a038a67537039258, user_id=649cc31d1202457297fe64996e09fb87, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.364188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.374735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1253/2495] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:47 2021] PUT /identity/v3/projects/e1f5a26c83914c96a038a67537039258/users/649cc31d1202457297fe64996e09fb87/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:47.386602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.386885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.387156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.419103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] MFA Rules not processed for user `649cc31d1202457297fe64996e09fb87`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:47.420597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:47.488173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1243/2496] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:47 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:47.498836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.500530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:47.556590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024434-8be4-4e7d-9873-3c7c4b520c99 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.560237 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.560867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.561142 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.561410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.569999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.571443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.580478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1254/2497] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:47 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:47.660394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:47.670110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a0d2-b111-4912-bc91-0a75e9c339a0 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:47.673690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ce48e-b055-4e1e-bbac-14f3fbe37313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:47.674363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce48e-b055-4e1e-bbac-14f3fbe37313 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:47.674641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce48e-b055-4e1e-bbac-14f3fbe37313 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:47.674908 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce48e-b055-4e1e-bbac-14f3fbe37313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:47.734090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ce48e-b055-4e1e-bbac-14f3fbe37313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:47.735541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ce48e-b055-4e1e-bbac-14f3fbe37313 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:47.744748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1244/2498] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:47 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:51.226805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:51.228233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:51.291956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a40302-bcde-4e29-9f77-8b9a6aa37ae5 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:51.297957 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:51.299559 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:51.299926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:51.300207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] PATH_INFO: `/v3/users/001422d6bd7940a2904224fca6115dcb` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:51.301717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=001422d6bd7940a2904224fca6115dcb)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:51.303719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:51.350107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001422d6bd7940a2904224fca6115dcb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.357832 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001422d6bd7940a2904224fca6115dcb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.364633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001422d6bd7940a2904224fca6115dcb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.365274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001422d6bd7940a2904224fca6115dcb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.376687 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001422d6bd7940a2904224fca6115dcb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.382519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1255/2499] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:51 2021] DELETE /identity/v3/users/001422d6bd7940a2904224fca6115dcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:51.387188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:51.387677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:51.387786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:51.404238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:51.405430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:51.462543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1245/2500] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:51.472496 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:51.473873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:51.527536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebba5f-8546-4d69-8c33-33c7756c23f0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:51.531120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:51.531740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:51.532018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:51.532288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:51.541334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:51.542922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:51.551905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1256/2501] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:51.803227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:51.804729 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:51.817769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bcadb-17e4-47cc-bd80-afd714775901 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:51.822704 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:51.823589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:51.823890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:51.824177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] PATH_INFO: `/v3/projects/8761219c11e24c4eb2337eee2e0ed3f1` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:51.825392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8761219c11e24c4eb2337eee2e0ed3f1)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:51.827438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:51.875777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8761219c11e24c4eb2337eee2e0ed3f1', 'request_id': 'req-64e36d54-dd08-4276-80d3-400d47e0f64c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.881489 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8761219c11e24c4eb2337eee2e0ed3f1', 'request_id': 'req-64e36d54-dd08-4276-80d3-400d47e0f64c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.888862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8761219c11e24c4eb2337eee2e0ed3f1', 'request_id': 'req-64e36d54-dd08-4276-80d3-400d47e0f64c'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.899819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] The token cache is being invalidate because project 8761219c11e24c4eb2337eee2e0ed3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:51.900101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.900734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:51.902289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1246/2502] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:51 2021] DELETE /identity/v3/projects/8761219c11e24c4eb2337eee2e0ed3f1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:51.906252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:51.916627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcd7d4-804b-42b4-8921-63ca5d88ba24 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:51.969682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:51.970580 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:51.970858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:51.971129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] PATH_INFO: `/v3/users/3869ee2766cc4c56913c7affa6de8933` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:51.972309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3869ee2766cc4c56913c7affa6de8933)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:51.974238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.019464 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3869ee2766cc4c56913c7affa6de8933'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.026975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3869ee2766cc4c56913c7affa6de8933'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.034592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3869ee2766cc4c56913c7affa6de8933'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.035248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3869ee2766cc4c56913c7affa6de8933'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.046568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3869ee2766cc4c56913c7affa6de8933'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.052326 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1257/2503] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:51 2021] DELETE /identity/v3/users/3869ee2766cc4c56913c7affa6de8933 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:52.322136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.323735 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:52.324153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.325889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:52.336564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e36d54-dd08-4276-80d3-400d47e0f64c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.391714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.392564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.392837 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.393107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] PATH_INFO: `/v3/projects/2d7da3a7b038450f9f7914a1c283accd` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.394322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7da3a7b038450f9f7914a1c283accd)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.396240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.401414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe162-0139-49ef-8c97-43f26870bc82 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.406277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.407139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.407424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.408300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] PATH_INFO: `/v3/users/b808c4b837ae447281660cdc05fd104d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.409521 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b808c4b837ae447281660cdc05fd104d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.411466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.441179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7da3a7b038450f9f7914a1c283accd', 'request_id': 'req-3d58c116-ca93-4ba0-a14b-81314ac5d598'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.447122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7da3a7b038450f9f7914a1c283accd', 'request_id': 'req-3d58c116-ca93-4ba0-a14b-81314ac5d598'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.454561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7da3a7b038450f9f7914a1c283accd', 'request_id': 'req-3d58c116-ca93-4ba0-a14b-81314ac5d598'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.457997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b808c4b837ae447281660cdc05fd104d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.465400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] The token cache is being invalidate because project 2d7da3a7b038450f9f7914a1c283accd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:52.465756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b808c4b837ae447281660cdc05fd104d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.465898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.466684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-3d58c116-ca93-4ba0-a14b-81314ac5d598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.468205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1247/2504] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:52 2021] DELETE /identity/v3/projects/2d7da3a7b038450f9f7914a1c283accd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:52.472791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b808c4b837ae447281660cdc05fd104d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.473625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b808c4b837ae447281660cdc05fd104d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.474011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0587d-f84c-4e79-9c80-470fdb1083c9 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.474369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0587d-f84c-4e79-9c80-470fdb1083c9 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.474644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0587d-f84c-4e79-9c80-470fdb1083c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.485487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-06fc965d-5960-4481-9225-449d7718999a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b808c4b837ae447281660cdc05fd104d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:52.491242 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1258/2505] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:52 2021] DELETE /identity/v3/users/b808c4b837ae447281660cdc05fd104d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:52.492741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-78b0587d-f84c-4e79-9c80-470fdb1083c9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:52.494098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-78b0587d-f84c-4e79-9c80-470fdb1083c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:52.495644 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.495938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.496226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.512922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:52.514110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:52.551191 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1248/2506] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:52.559732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.559952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.560234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.570617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1259/2507] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:52.578170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:52.579490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:52.580691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.581987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:52.587863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1249/2508] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:52.591932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.601276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b09976-62b2-42cb-a21f-36752cca4dac None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.606773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.607412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.607688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.607955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.608681 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:52.608986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.610605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.621994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1250/2509] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:09:52.626174 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.635519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d45ded-c245-452d-87ec-4119f4b3b7ad admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.638332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9dc445-bcb1-4e49-982d-27a632e74a24 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.640211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.640834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.641111 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.641380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.641925 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.642049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.642585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.642862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.643131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.643938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.652861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.654336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.664469 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1260/2510] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:52.670600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1251/2511] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:52 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:52.674628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.684427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200f84c-3426-4e70-866e-a87e6b201997 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.757465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.758611 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.758995 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.759137 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.759848 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.762015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.782595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1261/2512] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:52 2021] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:52.786660 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.797071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187af9b4-9636-4021-b77f-3d5addbc88f0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.801877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.803315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.803787 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.804205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.805121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.806895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.824294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1252/2513] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:52 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:52.828268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.839700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357434c-4d85-4870-b9b2-a94fac0fb880 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.844838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f1596-f81a-4651-8fab-4de7b4141095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.845523 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1596-f81a-4651-8fab-4de7b4141095 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.845956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1596-f81a-4651-8fab-4de7b4141095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.846282 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f1596-f81a-4651-8fab-4de7b4141095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.847066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f1596-f81a-4651-8fab-4de7b4141095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.848679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f1596-f81a-4651-8fab-4de7b4141095 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.859676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1262/2514] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:52.863981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:52.874868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22145f32-950a-4983-ae45-14d54ce5301c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:52.879881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:52.880783 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.881061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.881332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] PATH_INFO: `/v3/projects/c2a8b8e431094e25b2943d392cc961d1/users/61c1b45c6a5547e1856d9b47e4627629/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.898137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a8b8e431094e25b2943d392cc961d1, user_id=61c1b45c6a5547e1856d9b47e4627629, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:52.901380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:52.915170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1253/2515] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:52 2021] PUT /identity/v3/projects/c2a8b8e431094e25b2943d392cc961d1/users/61c1b45c6a5547e1856d9b47e4627629/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:52.928227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:52.928533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:52.928806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:52.957317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] MFA Rules not processed for user `61c1b45c6a5547e1856d9b47e4627629`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:52.958570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.026384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1263/2516] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:53.030865 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.094062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e88e9-57f5-4209-a29c-317cae1376d7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.098692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.099341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.099618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.099896 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.100583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.102538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.130606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1254/2517] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:53 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:53.132133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.143470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86011d52-e416-48c1-88ed-66148c1d6050 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.183885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.185622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.202056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.203295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.203799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.204084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.204821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.207143 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.233192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1264/2518] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:53 2021] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:53.234173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.244567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71f739-deee-4606-93f4-f791049da7cd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.249216 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.249938 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.250251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.250517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.251249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.252859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.252998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f977dd4-562c-4483-9f4f-e1ef2dc55a4b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.258404 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.259249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.259521 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.259822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] PATH_INFO: `/v3/projects/06ad2ab296e6474db6f30fd810006ed3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.261256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ad2ab296e6474db6f30fd810006ed3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.263180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.266883 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1265/2519] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:53.267902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.277435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633115d-73b6-4a29-a136-245a7c8fbed2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.282125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.283019 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.283301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.283571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] PATH_INFO: `/v3/projects/9cfa0ccd5a5c4999af5729ff30febb1f/users/c598e94106a34c4da181ad3651bf70b9/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.300550 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa0ccd5a5c4999af5729ff30febb1f, user_id=c598e94106a34c4da181ad3651bf70b9, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.303273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.310041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ad2ab296e6474db6f30fd810006ed3', 'request_id': 'req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.316422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1266/2520] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:53 2021] PUT /identity/v3/projects/9cfa0ccd5a5c4999af5729ff30febb1f/users/c598e94106a34c4da181ad3651bf70b9/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:53.319553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ad2ab296e6474db6f30fd810006ed3', 'request_id': 'req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.321006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.325033 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ad2ab296e6474db6f30fd810006ed3', 'request_id': 'req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.335340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] The token cache is being invalidate because project 06ad2ab296e6474db6f30fd810006ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:53.335637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.336283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.337812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1255/2521] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:53 2021] DELETE /identity/v3/projects/06ad2ab296e6474db6f30fd810006ed3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:53.341688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.343052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.380031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f2c26-c02a-479d-9e59-debdfb3c7518 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.385258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.385909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.386468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.386738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.387474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.389055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.398647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1267/2522] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:53 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:53.402615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.404222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.412058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7fa2-1cac-4a9d-a6fc-b2fed90198c8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.416167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b92ad-aeae-4978-b1bb-f2fa6f021bf5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.416906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.417798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.418081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.418381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] PATH_INFO: `/v3/users/649cc31d1202457297fe64996e09fb87` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.419601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649cc31d1202457297fe64996e09fb87)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.420918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4cc7-3aee-49df-9ed8-c8086ea3955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.421536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.421771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4cc7-3aee-49df-9ed8-c8086ea3955e admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.422047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4cc7-3aee-49df-9ed8-c8086ea3955e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.422357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4cc7-3aee-49df-9ed8-c8086ea3955e admin admin] PATH_INFO: `/v3/projects/9cfa0ccd5a5c4999af5729ff30febb1f/users/c598e94106a34c4da181ad3651bf70b9/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.424366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e4cc7-3aee-49df-9ed8-c8086ea3955e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa0ccd5a5c4999af5729ff30febb1f, user_id=c598e94106a34c4da181ad3651bf70b9, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.427006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e4cc7-3aee-49df-9ed8-c8086ea3955e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.437683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1268/2523] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:53 2021] PUT /identity/v3/projects/9cfa0ccd5a5c4999af5729ff30febb1f/users/c598e94106a34c4da181ad3651bf70b9/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:53.448425 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.448798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.449086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.468770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649cc31d1202457297fe64996e09fb87'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.476716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] MFA Rules not processed for user `c598e94106a34c4da181ad3651bf70b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:53.477999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.478178 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649cc31d1202457297fe64996e09fb87'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.485035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649cc31d1202457297fe64996e09fb87'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.496759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649cc31d1202457297fe64996e09fb87'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.497437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649cc31d1202457297fe64996e09fb87'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.503381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1256/2524] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:53 2021] DELETE /identity/v3/users/649cc31d1202457297fe64996e09fb87 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:53.550998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1269/2525] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:53 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:53.562367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.564131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.624695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec9c9e-eb51-4417-81ec-2cd7fd673928 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.628703 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93bb20-9baf-4ebe-8770-d8602877e3d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.629379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93bb20-9baf-4ebe-8770-d8602877e3d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.629643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93bb20-9baf-4ebe-8770-d8602877e3d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.629968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93bb20-9baf-4ebe-8770-d8602877e3d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.691155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93bb20-9baf-4ebe-8770-d8602877e3d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.692628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93bb20-9baf-4ebe-8770-d8602877e3d4 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.701999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1257/2526] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:53 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:09:53.771799 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:53.773124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:53.859251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266e5a-5d05-4f96-a88c-005a5e9cc0a9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:53.922783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:53.923731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:53.924396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:53.924396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] PATH_INFO: `/v3/projects/e1f5a26c83914c96a038a67537039258` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:53.930480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f5a26c83914c96a038a67537039258)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:53.932542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:53.983188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f5a26c83914c96a038a67537039258', 'request_id': 'req-cc2c42e5-050b-454c-ba3b-2a629801eb37'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.989418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f5a26c83914c96a038a67537039258', 'request_id': 'req-cc2c42e5-050b-454c-ba3b-2a629801eb37'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:53.996974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f5a26c83914c96a038a67537039258', 'request_id': 'req-cc2c42e5-050b-454c-ba3b-2a629801eb37'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.007430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] The token cache is being invalidate because project e1f5a26c83914c96a038a67537039258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:54.007647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.008319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.009841 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1270/2527] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:53 2021] DELETE /identity/v3/projects/e1f5a26c83914c96a038a67537039258 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:54.016065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d4e8d-67d7-4dbb-8578-1e7a6bb6e245 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.016297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d4e8d-67d7-4dbb-8578-1e7a6bb6e245 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.016766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d4e8d-67d7-4dbb-8578-1e7a6bb6e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.036482 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4a1d4e8d-67d7-4dbb-8578-1e7a6bb6e245 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:54.037674 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4a1d4e8d-67d7-4dbb-8578-1e7a6bb6e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.079935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.081371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.103408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1258/2528] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:54.111199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.111490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.111771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.129121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:54.130346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.138426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1259/2529] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:54.142428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.144510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c42e5-050b-454c-ba3b-2a629801eb37 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.150002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.150820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.151100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.151373 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] PATH_INFO: `/v3/users/61c1b45c6a5547e1856d9b47e4627629` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.151562 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf341a-23bc-46fe-a780-0d03211362ea None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.152588 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c1b45c6a5547e1856d9b47e4627629)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.154620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.156165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.156800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.157072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.157341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.158061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:54.158387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.159957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.171494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1260/2530] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:09:54.175732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.185008 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a87b-e307-4643-9a44-dab1dee933ea admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.189675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.190322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.190625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.190897 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.191584 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.193458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.200240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c1b45c6a5547e1856d9b47e4627629'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.207446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c1b45c6a5547e1856d9b47e4627629'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.215310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c1b45c6a5547e1856d9b47e4627629'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.215959 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c1b45c6a5547e1856d9b47e4627629'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.218045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1261/2531] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:54 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:54.222354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.229172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8a452d13-c0bc-4d07-a6e6-0f5f26579952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c1b45c6a5547e1856d9b47e4627629'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.235818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1271/2532] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:54 2021] DELETE /identity/v3/users/61c1b45c6a5547e1856d9b47e4627629 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:54.240048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.240336 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.240617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.257162 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:54.258895 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.284761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fe6b6-db03-41e9-93f0-6b9c76e946bc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.317390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1272/2533] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:54.327829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.329152 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.340488 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.341156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.341437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.341711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.342445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.344355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.367500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1262/2534] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:54 2021] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:54.368552 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.370248 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.381530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9313434-91c5-4e89-ae04-497910a4eea0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.385542 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d4d0b-ceae-47e8-8e8e-e808a5c44cc8 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.386911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.387536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.387812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.388083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.388803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.389488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.390125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.390436 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.390533 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.390711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.400277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.401020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1263/2535] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:54.402036 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.405254 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.415075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347f117-ed5a-4eec-bc44-0662d83ed9e8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.416424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1273/2536] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:54.420095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f294-edf5-4e95-a4ef-bcae4846cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.420743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f294-edf5-4e95-a4ef-bcae4846cbcf admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.421021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f294-edf5-4e95-a4ef-bcae4846cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.421300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f294-edf5-4e95-a4ef-bcae4846cbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.422031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81f294-edf5-4e95-a4ef-bcae4846cbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.423656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81f294-edf5-4e95-a4ef-bcae4846cbcf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.436628 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1264/2537] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:54.437805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.447836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11b396-8f83-4bf5-80ce-36cdc85ce3a7 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.452480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.453353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.453633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.453909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] PATH_INFO: `/v3/projects/8d6505d138c547538566bf960f213d4a/users/c53181e8b308404185e2c38749ee619b/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.470435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6505d138c547538566bf960f213d4a, user_id=c53181e8b308404185e2c38749ee619b, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.473393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.486688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1274/2538] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:54 2021] PUT /identity/v3/projects/8d6505d138c547538566bf960f213d4a/users/c53181e8b308404185e2c38749ee619b/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:54.492024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.492308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.492633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.511641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:54.512959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.572334 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1265/2539] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:54.586409 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.588117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.644100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e52834-0ea7-41d4-b887-2e6dc0d437ca admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.648057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.649309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.649596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.649877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.659395 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.660752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.670727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1275/2540] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:54.715094 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.716536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:54.729069 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28cfbb-e3fa-4764-9b63-c6e8c127fc82 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.734776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.735727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.736082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.736431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] PATH_INFO: `/v3/projects/c2a8b8e431094e25b2943d392cc961d1` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.737823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a8b8e431094e25b2943d392cc961d1)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.740485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.791962 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a8b8e431094e25b2943d392cc961d1', 'request_id': 'req-d77442c2-27f2-49a2-8020-bf8ebfb7d688'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.798300 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a8b8e431094e25b2943d392cc961d1', 'request_id': 'req-d77442c2-27f2-49a2-8020-bf8ebfb7d688'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.810651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a8b8e431094e25b2943d392cc961d1', 'request_id': 'req-d77442c2-27f2-49a2-8020-bf8ebfb7d688'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.824007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] The token cache is being invalidate because project c2a8b8e431094e25b2943d392cc961d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:54.824383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.825067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.826671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1266/2541] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:54 2021] DELETE /identity/v3/projects/c2a8b8e431094e25b2943d392cc961d1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:54.831068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:54.841082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd08de-8610-408c-9cde-38b3a49d93b7 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:54.899466 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:54.900414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:54.900941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:54.901188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] PATH_INFO: `/v3/users/c598e94106a34c4da181ad3651bf70b9` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:54.902474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c598e94106a34c4da181ad3651bf70b9)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:54.904435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:54.957500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c598e94106a34c4da181ad3651bf70b9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.970603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c598e94106a34c4da181ad3651bf70b9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.978810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c598e94106a34c4da181ad3651bf70b9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.979536 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c598e94106a34c4da181ad3651bf70b9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:54.997657 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-ff81fdbf-8c98-4492-b577-0457b1b9e5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c598e94106a34c4da181ad3651bf70b9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:55.009689 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1276/2542] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:09:54 2021] DELETE /identity/v3/users/c598e94106a34c4da181ad3651bf70b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:55.336861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.338892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:55.364979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77442c2-27f2-49a2-8020-bf8ebfb7d688 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.441734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.442891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.443180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.443511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] PATH_INFO: `/v3/projects/9cfa0ccd5a5c4999af5729ff30febb1f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.446602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfa0ccd5a5c4999af5729ff30febb1f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:55.449568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:55.513152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfa0ccd5a5c4999af5729ff30febb1f', 'request_id': 'req-9d4622fb-8cce-4351-8c41-a54517ef50aa'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:55.523827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfa0ccd5a5c4999af5729ff30febb1f', 'request_id': 'req-9d4622fb-8cce-4351-8c41-a54517ef50aa'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:55.533862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfa0ccd5a5c4999af5729ff30febb1f', 'request_id': 'req-9d4622fb-8cce-4351-8c41-a54517ef50aa'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:55.545410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] The token cache is being invalidate because project 9cfa0ccd5a5c4999af5729ff30febb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:09:55.545705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:55.546370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-9d4622fb-8cce-4351-8c41-a54517ef50aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:09:55.547904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1267/2543] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:09:55 2021] DELETE /identity/v3/projects/9cfa0ccd5a5c4999af5729ff30febb1f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:55.553592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.554059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.554167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.575934 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:55.577363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:55.642407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1277/2544] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:55.651916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.652211 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.652511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.674075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:55.675995 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:55.685352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1268/2545] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:09:55.689820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.700504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb072-9916-4a45-85dd-6b5c146a2d07 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.705626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.706435 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.706806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.707342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.708194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:09:55.708590 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:55.711033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:55.727882 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1278/2546] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:09:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:09:55.729349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.738794 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628e1aa-c12b-4884-9456-2ebc2d9a359c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.743793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.744571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.744953 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.745485 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.746601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:55.748666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:55.780063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1269/2547] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:55 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:55.784102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.793978 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008886aa-ef8c-451f-97d6-64fce8f13179 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.855382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.856433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.856880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.857150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.857868 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:55.860348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:55.888896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1279/2548] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:55 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:55.890118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.901241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4837b-ecf4-4d7b-bcf4-64ea00b1b4d1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.906714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.907383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.907665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.907951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.908700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:55.910443 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:55.921863 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1270/2549] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:55.926475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.941130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6963faa-c1e3-4701-833e-1ded1ec0a417 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.946976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865751d-28cc-4baf-bc78-dcb443c38217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.947649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865751d-28cc-4baf-bc78-dcb443c38217 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.947954 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865751d-28cc-4baf-bc78-dcb443c38217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.948232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865751d-28cc-4baf-bc78-dcb443c38217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.948975 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865751d-28cc-4baf-bc78-dcb443c38217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:55.950606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865751d-28cc-4baf-bc78-dcb443c38217 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:55.962027 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1280/2550] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:55.965989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:55.975799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab20b-dc38-4238-8626-6f71bd633e7d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:55.980580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:55.981680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:55.981928 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:55.982391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] PATH_INFO: `/v3/projects/be7c424e026045b598846a5597903e5f/users/76fc7a80c8fc41acbcf0cd5477af2bf5/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:55.997742 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7c424e026045b598846a5597903e5f, user_id=76fc7a80c8fc41acbcf0cd5477af2bf5, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.000857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.025503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1271/2551] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:55 2021] PUT /identity/v3/projects/be7c424e026045b598846a5597903e5f/users/76fc7a80c8fc41acbcf0cd5477af2bf5/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:56.027691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.028146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.028842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.067269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] MFA Rules not processed for user `76fc7a80c8fc41acbcf0cd5477af2bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:56.069197 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:56.158431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1281/2552] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:56 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:56.163265 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.248852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd15bff-ed8c-4591-8c3e-6db1da93b27c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.263262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.265644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.265929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.266247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.266969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.278108 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.311685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1272/2553] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:56 2021] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:56.315719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.333188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc984bde-188f-4fbf-b05b-9d701de7b0a6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.397437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.398348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.398624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.398892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.399643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.402006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.428082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1282/2554] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:56 2021] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:56.434106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.445905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc28e7-8489-413e-a7da-cf48880ee963 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.451053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.451934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.452221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.452498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.453249 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.454949 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.465956 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1273/2555] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:56.469875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.479707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81dca-3f6f-4ffa-987e-da35cbb91e30 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.484278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b583ef-df8d-4f95-ad3d-6129e9cd368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.484941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b583ef-df8d-4f95-ad3d-6129e9cd368d admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.485198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b583ef-df8d-4f95-ad3d-6129e9cd368d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.485465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b583ef-df8d-4f95-ad3d-6129e9cd368d admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.486256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b583ef-df8d-4f95-ad3d-6129e9cd368d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.488212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b583ef-df8d-4f95-ad3d-6129e9cd368d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.499935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1283/2556] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:56.504362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.515377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796305d6-c48b-4f06-8826-002707c56ee2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.521898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.522862 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.523224 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.523501 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] PATH_INFO: `/v3/projects/797ffb7eecc046889547899134e8efb3/users/1dadde70cd584eaf92319fdcf7848a14/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.542308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797ffb7eecc046889547899134e8efb3, user_id=1dadde70cd584eaf92319fdcf7848a14, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.545002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.560942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1274/2557] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:56 2021] PUT /identity/v3/projects/797ffb7eecc046889547899134e8efb3/users/1dadde70cd584eaf92319fdcf7848a14/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:56.571917 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.572764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.573046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.604000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] MFA Rules not processed for user `1dadde70cd584eaf92319fdcf7848a14`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:56.605210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:56.669543 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1284/2558] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:56 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:56.674422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.742654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738e73-46ec-4b5c-986a-1cc94152d806 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.747868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.748630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.748984 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.749328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.750119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.752149 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.782522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1275/2559] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:56 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:56.785691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.807450 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa1e5a-2b49-4d58-8e66-3563e3b409cd None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.876557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.876557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.876911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.877133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.878003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.879965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.905815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1285/2560] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:56 2021] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:56.907067 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.918799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57134e91-1106-4b3c-90af-76e55531df8a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.924434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.928901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.929428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.929702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.930486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.932464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:56.943619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1276/2561] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:09:56.948113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:56.958802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2698bf3-1bb0-4c4c-a555-cf2d29dbc27b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:56.966032 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:56.966990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:56.967272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:56.967552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] PATH_INFO: `/v3/projects/b5c67436da7d46349c8a5c673f61f510/users/f034d2a483164bb688f752c554218c5d/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:56.984675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c67436da7d46349c8a5c673f61f510, user_id=f034d2a483164bb688f752c554218c5d, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:56.987613 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:57.012739 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1286/2562] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:56 2021] PUT /identity/v3/projects/b5c67436da7d46349c8a5c673f61f510/users/f034d2a483164bb688f752c554218c5d/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:57.016671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:57.029421 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ae792-b693-423f-b5fb-ac144dd05fd8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:57.102654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0fcb-b3ce-45d7-b217-1cca4da2d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:57.103901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0fcb-b3ce-45d7-b217-1cca4da2d780 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:57.104187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0fcb-b3ce-45d7-b217-1cca4da2d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:57.104462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0fcb-b3ce-45d7-b217-1cca4da2d780 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:57.105209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0fcb-b3ce-45d7-b217-1cca4da2d780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:57.106842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0fcb-b3ce-45d7-b217-1cca4da2d780 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:57.121385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1277/2563] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:57 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:57.125516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:57.135727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ca4c4-ad5d-4656-90e6-db59a3ba8e7d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:57.141414 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:57.142452 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:57.142794 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:57.143130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] PATH_INFO: `/v3/projects/b5c67436da7d46349c8a5c673f61f510/users/f034d2a483164bb688f752c554218c5d/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:57.145217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c67436da7d46349c8a5c673f61f510, user_id=f034d2a483164bb688f752c554218c5d, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:57.148506 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:57.159366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1287/2564] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:57 2021] PUT /identity/v3/projects/b5c67436da7d46349c8a5c673f61f510/users/f034d2a483164bb688f752c554218c5d/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:57.221676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccc56-7b42-4e2f-8c95-77ea603c1acb None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:57.221951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccc56-7b42-4e2f-8c95-77ea603c1acb None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:57.222341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeccc56-7b42-4e2f-8c95-77ea603c1acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:57.250225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-afeccc56-7b42-4e2f-8c95-77ea603c1acb None None] MFA Rules not processed for user `f034d2a483164bb688f752c554218c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:57.251431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-afeccc56-7b42-4e2f-8c95-77ea603c1acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:57.338171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1278/2565] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:57 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:57.349318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:57.351076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:57.423343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7855eaf-455c-455d-85c3-0a40c4b810cb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:57.427810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:57.428505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:57.428788 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:57.429066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:57.492358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:57.493835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:57.514439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1288/2566] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:57 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:58.917377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:58.917850 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:58.917941 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:58.955144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] MFA Rules not processed for user `c53181e8b308404185e2c38749ee619b`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:09:58.956820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:59.036256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1279/2567] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:09:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:09:59.041239 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.042823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:59.103051 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.104530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:09:59.117451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf54ae-08d0-4554-b56a-0e04464f71b4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.121329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.121964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.122273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.122548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.123722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71e1d2-1f0a-468b-ba76-5cd4908aaae6 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.128777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.129607 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.129884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.130167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.130914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.132852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.192512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1289/2568] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:09:59 2021] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:09:59.197153 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.201072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.202684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.212198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1280/2569] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:59 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:09:59.268670 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027f21-2d92-4526-886b-65d313fcc1b3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.273764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.274567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.274921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.275269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.276069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.278076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.304997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1290/2570] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:09:59 2021] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:09:59.308970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.321530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc7d0-66c2-454c-a502-317f6fd5ac61 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.330661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.331631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.332025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.332716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.333648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.335566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.345978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1281/2571] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:59 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:59.350054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.360462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d075fd-700b-4a77-a927-a7540a645f62 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.365419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.366405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.367524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.367966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] PATH_INFO: `/v3/projects/5b8ac2ec2ba941859063ce6f15001452/users/d19c9032b3e04003a81c0da1cec2a4ea/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.386028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8ac2ec2ba941859063ce6f15001452, user_id=d19c9032b3e04003a81c0da1cec2a4ea, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.389091 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.407005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1291/2572] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:59 2021] PUT /identity/v3/projects/5b8ac2ec2ba941859063ce6f15001452/users/d19c9032b3e04003a81c0da1cec2a4ea/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:09:59.408667 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.424335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e51300-0332-4ba8-9688-c45b910ac47d admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.497972 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.498690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.498967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.499237 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.500042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.501645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.515764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1282/2573] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:09:59 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:09:59.519936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.532059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca4351-38e6-4930-8107-c4fe94003d95 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:09:59.536952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c3239-c356-460e-98ff-7f990a6513de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:09:59.537869 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c3239-c356-460e-98ff-7f990a6513de admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:09:59.538176 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c3239-c356-460e-98ff-7f990a6513de admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:09:59.538973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c3239-c356-460e-98ff-7f990a6513de admin admin] PATH_INFO: `/v3/projects/5b8ac2ec2ba941859063ce6f15001452/users/d19c9032b3e04003a81c0da1cec2a4ea/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:09:59.541123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c3239-c356-460e-98ff-7f990a6513de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8ac2ec2ba941859063ce6f15001452, user_id=d19c9032b3e04003a81c0da1cec2a4ea, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:09:59.543813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c3239-c356-460e-98ff-7f990a6513de admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:09:59.557780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1292/2574] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:09:59 2021] PUT /identity/v3/projects/5b8ac2ec2ba941859063ce6f15001452/users/d19c9032b3e04003a81c0da1cec2a4ea/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:09:59.870750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:09:59.953087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d8312-0e4e-4d2b-8c22-73ea2eec6bba admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:00.057779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:00.058686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:00.058967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:00.059238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:00.148197 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:00.149963 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:00.162707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1283/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:09:59 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:03.954596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:03.955066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:03.955410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:04.021818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] MFA Rules not processed for user `d19c9032b3e04003a81c0da1cec2a4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:04.023463 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:04.108343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1293/2576] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:03 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:04.120791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:04.122340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:04.197509 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0e6f7-06dc-49e1-9e36-f870c57eb119 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:04.202894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3dc2-480c-4f8b-9fae-d47bd33de7e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:04.203671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3dc2-480c-4f8b-9fae-d47bd33de7e3 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:04.203951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3dc2-480c-4f8b-9fae-d47bd33de7e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:04.204223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3dc2-480c-4f8b-9fae-d47bd33de7e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:04.261904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3dc2-480c-4f8b-9fae-d47bd33de7e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:04.263916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3dc2-480c-4f8b-9fae-d47bd33de7e3 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:04.274532 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1284/2577] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:04 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:10:04.436761 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:04.498449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53982370-1b94-4e60-a02e-eaf3b62a2cde None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:04.503012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:04.503985 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:04.504192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:04.504432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] PATH_INFO: `/v3/users/76fc7a80c8fc41acbcf0cd5477af2bf5` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:04.505696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fc7a80c8fc41acbcf0cd5477af2bf5)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:04.508293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:04.558661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fc7a80c8fc41acbcf0cd5477af2bf5'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:04.569045 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fc7a80c8fc41acbcf0cd5477af2bf5'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:04.579819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fc7a80c8fc41acbcf0cd5477af2bf5'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:04.580858 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fc7a80c8fc41acbcf0cd5477af2bf5'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:04.593171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fc7a80c8fc41acbcf0cd5477af2bf5'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:04.603547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1294/2578] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:04 2021] DELETE /identity/v3/users/76fc7a80c8fc41acbcf0cd5477af2bf5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:04.604748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:04.605261 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:04.605605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:04.625368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:04.626775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:04.710776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1285/2579] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:10:04.718518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:04.720624 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:04.800113 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fbce74-dc15-4567-952a-fdf28b803e05 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:04.804068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:04.804666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:04.804941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:04.805213 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:04.818875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:04.821167 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:04.833371 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1295/2580] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:05.244734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:05.246301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:05.261652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb5630-3c57-4383-944b-d260114a68aa None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:05.268912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:05.270652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:05.271175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:05.271671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] PATH_INFO: `/v3/projects/be7c424e026045b598846a5597903e5f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:05.274347 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7c424e026045b598846a5597903e5f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:05.276564 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:05.345393 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7c424e026045b598846a5597903e5f', 'request_id': 'req-842e4123-3130-4ccc-9551-1f66ae0b8e07'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.353153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7c424e026045b598846a5597903e5f', 'request_id': 'req-842e4123-3130-4ccc-9551-1f66ae0b8e07'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.363568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7c424e026045b598846a5597903e5f', 'request_id': 'req-842e4123-3130-4ccc-9551-1f66ae0b8e07'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.378006 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] The token cache is being invalidate because project be7c424e026045b598846a5597903e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:05.378473 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.380405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.383411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1286/2581] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:05 2021] DELETE /identity/v3/projects/be7c424e026045b598846a5597903e5f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:05.388740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:05.401787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4483-e157-4e19-8ad4-d3f7e3e77e5c service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:05.471493 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:05.472489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:05.472842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:05.473188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] PATH_INFO: `/v3/users/1dadde70cd584eaf92319fdcf7848a14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:05.474618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dadde70cd584eaf92319fdcf7848a14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:05.477193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:05.545250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dadde70cd584eaf92319fdcf7848a14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.554383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dadde70cd584eaf92319fdcf7848a14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.563784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dadde70cd584eaf92319fdcf7848a14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.564517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dadde70cd584eaf92319fdcf7848a14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.577380 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cacd8e94-c883-4d44-b794-24f6bd6788f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dadde70cd584eaf92319fdcf7848a14'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:05.583618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1296/2582] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:05 2021] DELETE /identity/v3/users/1dadde70cd584eaf92319fdcf7848a14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:06.186661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:06.188136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:06.193711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:06.193994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:06.194913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:06.218736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] MFA Rules not processed for user `c53181e8b308404185e2c38749ee619b`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:06.219514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e4123-3130-4ccc-9551-1f66ae0b8e07 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:06.221011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:06.285298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1297/2583] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:06.322775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:06.323695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:06.324023 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:06.324298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] PATH_INFO: `/v3/projects/797ffb7eecc046889547899134e8efb3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:06.325553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=797ffb7eecc046889547899134e8efb3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:06.327521 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:06.393279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797ffb7eecc046889547899134e8efb3', 'request_id': 'req-0f956972-19d1-47bc-96d2-47267ba63949'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.402355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797ffb7eecc046889547899134e8efb3', 'request_id': 'req-0f956972-19d1-47bc-96d2-47267ba63949'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.415517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797ffb7eecc046889547899134e8efb3', 'request_id': 'req-0f956972-19d1-47bc-96d2-47267ba63949'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.429024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] The token cache is being invalidate because project 797ffb7eecc046889547899134e8efb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:06.429315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.429974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.431563 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1287/2584] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:06 2021] DELETE /identity/v3/projects/797ffb7eecc046889547899134e8efb3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:06.435606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:06.437040 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:06.453842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6e88-f3d0-4a71-bff8-5c14e9f5304d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:06.517730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:06.518633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:06.518921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:06.519193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] PATH_INFO: `/v3/users/f034d2a483164bb688f752c554218c5d` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:06.520442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f034d2a483164bb688f752c554218c5d)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:06.522460 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:06.583224 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f034d2a483164bb688f752c554218c5d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.592016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f034d2a483164bb688f752c554218c5d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.599905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f034d2a483164bb688f752c554218c5d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.601187 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f034d2a483164bb688f752c554218c5d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.613428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6844a9a1-512e-42dc-b6e7-658ec51824ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f034d2a483164bb688f752c554218c5d'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:06.620107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1298/2585] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:06 2021] DELETE /identity/v3/users/f034d2a483164bb688f752c554218c5d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:10:06.904932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:06.906468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:06.920247 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f956972-19d1-47bc-96d2-47267ba63949 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:06.982777 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:06.983645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:06.983924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:06.984213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] PATH_INFO: `/v3/projects/b5c67436da7d46349c8a5c673f61f510` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:06.985409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c67436da7d46349c8a5c673f61f510)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:06.987377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:07.033055 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c67436da7d46349c8a5c673f61f510', 'request_id': 'req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:07.039463 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c67436da7d46349c8a5c673f61f510', 'request_id': 'req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:07.047422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c67436da7d46349c8a5c673f61f510', 'request_id': 'req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:07.058670 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] The token cache is being invalidate because project b5c67436da7d46349c8a5c673f61f510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:07.058979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:07.059619 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:07.061166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1288/2586] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:06 2021] DELETE /identity/v3/projects/b5c67436da7d46349c8a5c673f61f510 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:40.842330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:40.842831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:40.842932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:40.860470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:40.861769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:40.917246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1299/2587] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:10:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:40.964782 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:40.966310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:41.034738 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fb7d4-3f4a-4fd3-985e-1c8e07d3d59a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:41.040328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:41.040987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:41.041271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:41.041550 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:41.049890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:41.052098 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:41.060283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1289/2588] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:10:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:10:42.130470 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:42.132056 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:42.201274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6c33a-8cca-4c2c-b618-b01ea66e775e None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:42.204931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:42.205585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:42.205865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:42.206138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:42.208508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:42.280897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:42.282410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:42.307179 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1300/2589] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:42 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:49.899314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:49.901479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:49.914204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c2679-e795-40de-81f0-e4622602de05 service swift] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:49.917824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:49.918503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:49.918773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:49.919044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:49.920921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:49.988093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:49.989675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:50.000605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1290/2590] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:53.769708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:53.771313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:53.785158 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239e9e8-ee00-40ac-8fd5-19af51449005 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:53.789676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:53.790562 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:53.790836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:53.791104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] PATH_INFO: `/v3/users/ff7f1cc9a2214907871542822081375f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:53.792298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7f1cc9a2214907871542822081375f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:53.794245 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:53.839708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7f1cc9a2214907871542822081375f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:53.846924 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7f1cc9a2214907871542822081375f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:53.854478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7f1cc9a2214907871542822081375f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:53.855118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7f1cc9a2214907871542822081375f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:53.866747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-23f7288f-529a-4ecf-9e70-5c06495bfb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7f1cc9a2214907871542822081375f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:53.872669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1301/2591] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:53 2021] DELETE /identity/v3/users/ff7f1cc9a2214907871542822081375f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:54.055167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.067685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328026b4-b76e-4c58-a881-7ca1fc23d893 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.132350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.133344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.133933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.134309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] PATH_INFO: `/v3/projects/9d0255d615a14a41af48a7a999a42469` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.135607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0255d615a14a41af48a7a999a42469)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.137616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.188574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0255d615a14a41af48a7a999a42469', 'request_id': 'req-818dfb8b-5095-4c13-aa58-d638d39a5db7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:54.195221 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0255d615a14a41af48a7a999a42469', 'request_id': 'req-818dfb8b-5095-4c13-aa58-d638d39a5db7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:54.203005 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0255d615a14a41af48a7a999a42469', 'request_id': 'req-818dfb8b-5095-4c13-aa58-d638d39a5db7'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:54.214059 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] The token cache is being invalidate because project 9d0255d615a14a41af48a7a999a42469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:54.214376 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:54.215029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-818dfb8b-5095-4c13-aa58-d638d39a5db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:54.216592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1291/2592] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:54 2021] DELETE /identity/v3/projects/9d0255d615a14a41af48a7a999a42469 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:10:54.223173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.223643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.224022 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.243572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:54.244364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:54.314440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1302/2593] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:10:54.322766 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.323054 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.323331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.342539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:54.343780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:54.352654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1292/2594] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:54.356961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.367619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce606-b4d4-405e-8dc4-fed4230c134c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.372973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.373810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.374116 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.374640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.375498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:10:54.375826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.378300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.393696 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1303/2595] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:10:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:10:54.395346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.404453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36328-0d9f-4ca4-9eed-3eea2058da99 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.409165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.410378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.410660 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.410937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.411648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.413557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.448487 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1293/2596] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:10:54.453004 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.462770 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef35178-f711-4c77-9f32-e0dcfd769265 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.517002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.517665 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.517941 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.518258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.518964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.520862 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.541299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1304/2597] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:10:54.545099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.555828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b94df-a100-427d-ac25-967f0a40e22c admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.560439 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.561081 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.561362 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.561634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.562408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.564001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.574163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1294/2598] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:10:54.578198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.588347 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224710a0-a9a1-4afa-b6fa-3590dd4d726f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.592898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff308d9-78f9-473a-8953-3da6d4f04e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.593538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff308d9-78f9-473a-8953-3da6d4f04e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.593813 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff308d9-78f9-473a-8953-3da6d4f04e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.594082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff308d9-78f9-473a-8953-3da6d4f04e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.594845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff308d9-78f9-473a-8953-3da6d4f04e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.596417 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff308d9-78f9-473a-8953-3da6d4f04e5a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.609378 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1305/2599] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:10:54.610538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.620906 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db087a9b-ad2c-4622-b09e-ff5df4751918 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.625512 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.626405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.626686 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.626952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] PATH_INFO: `/v3/projects/6a6237058b4c4fa9b12e608669243b1e/users/a1aacbc12ad4415886a8733c8627a9f8/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.643172 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6237058b4c4fa9b12e608669243b1e, user_id=a1aacbc12ad4415886a8733c8627a9f8, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.650101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.664933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1295/2600] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:10:54 2021] PUT /identity/v3/projects/6a6237058b4c4fa9b12e608669243b1e/users/a1aacbc12ad4415886a8733c8627a9f8/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:10:54.676760 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.677052 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.677376 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.704782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] MFA Rules not processed for user `a1aacbc12ad4415886a8733c8627a9f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:54.705973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:54.770193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1306/2601] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:54.774725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.834975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349865f8-e6ef-4919-a09a-4adb58bb35af admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.839980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.840647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.840927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.841199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.841901 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.844481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.872960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1296/2602] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:10:54.877090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.889338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0110e-26f5-490d-b73a-6c3dbaa28c35 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.944859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.945522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.945808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.946087 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.946831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.948793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:54.968258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1307/2603] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:10:54 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:10:54.972388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:54.982538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f6ea-0bf7-41d5-8f3a-98eebea90d2f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:54.987061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:54.988217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:54.988490 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:54.988759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:54.989524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:54.991146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:55.001957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1297/2604] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:10:55.006886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:55.016965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f8a05-de8a-42d3-bd98-95512116accc admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:55.021671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:55.022586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.022864 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.023139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] PATH_INFO: `/v3/projects/3664970e1eb34fe9a16b706580aaadca/users/dd0a79ab0851427b81232c50a4e6a3a8/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.038284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3664970e1eb34fe9a16b706580aaadca, user_id=dd0a79ab0851427b81232c50a4e6a3a8, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:55.041584 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:55.056048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1308/2605] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:10:55 2021] PUT /identity/v3/projects/3664970e1eb34fe9a16b706580aaadca/users/dd0a79ab0851427b81232c50a4e6a3a8/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:55.060194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:55.070408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021654c4-2410-4dc9-98cb-7ebc52fb14b2 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:55.128241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fede621-43dd-4ad2-acce-8e908df0038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:55.129179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fede621-43dd-4ad2-acce-8e908df0038a admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.129546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fede621-43dd-4ad2-acce-8e908df0038a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.129819 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fede621-43dd-4ad2-acce-8e908df0038a admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.130985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fede621-43dd-4ad2-acce-8e908df0038a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:55.132187 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fede621-43dd-4ad2-acce-8e908df0038a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:55.143319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1298/2606] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:55 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:10:55.147684 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:55.172013 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5222be-70c9-4a09-9ea9-b7acd41100c6 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:55.178576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:55.180901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.181752 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.182263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] PATH_INFO: `/v3/projects/3664970e1eb34fe9a16b706580aaadca/users/dd0a79ab0851427b81232c50a4e6a3a8/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.187914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3664970e1eb34fe9a16b706580aaadca, user_id=dd0a79ab0851427b81232c50a4e6a3a8, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:55.192096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:55.208793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1309/2607] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:10:55 2021] PUT /identity/v3/projects/3664970e1eb34fe9a16b706580aaadca/users/dd0a79ab0851427b81232c50a4e6a3a8/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:55.219277 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.219636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.219986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.247812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] MFA Rules not processed for user `dd0a79ab0851427b81232c50a4e6a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:55.249767 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:55.318086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1299/2608] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:55 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:55.330138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:55.333335 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:55.391286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a45a-fbdf-4513-9573-d0771fc9678c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:55.395491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291c4a4-2e45-4ac9-a368-025cfba4a227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:55.396159 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c4a4-2e45-4ac9-a368-025cfba4a227 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.396441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c4a4-2e45-4ac9-a368-025cfba4a227 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.396711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291c4a4-2e45-4ac9-a368-025cfba4a227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.406134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291c4a4-2e45-4ac9-a368-025cfba4a227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:55.407586 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291c4a4-2e45-4ac9-a368-025cfba4a227 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:55.419165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1310/2609] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:55 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:55.726466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:55.785386 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a98548-d2e6-44c7-93f1-3ae259841c45 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:55.790448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:55.791351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.791631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.791903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] PATH_INFO: `/v3/users/a1aacbc12ad4415886a8733c8627a9f8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.793104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1aacbc12ad4415886a8733c8627a9f8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:55.795061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:55.842469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1aacbc12ad4415886a8733c8627a9f8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:55.851629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1aacbc12ad4415886a8733c8627a9f8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:55.859378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1aacbc12ad4415886a8733c8627a9f8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:55.872911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1aacbc12ad4415886a8733c8627a9f8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:55.873645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1aacbc12ad4415886a8733c8627a9f8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:55.880387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1300/2610] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:55 2021] DELETE /identity/v3/users/a1aacbc12ad4415886a8733c8627a9f8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:55.885736 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:55.886260 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:55.886397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:55.905488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:55.906776 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:55.966766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1311/2611] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:55.977177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:55.979478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:56.042175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2640d2-c550-43df-896d-ca309bf8f163 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:56.046096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:56.047018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:56.047186 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:56.047469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:56.062854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:56.064297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:56.074708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1301/2612] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:56.396874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:56.396874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:56.402408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58360c55-2a34-45ee-b631-46fe938a7051 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:56.407299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:56.408233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:56.408518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:56.408793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] PATH_INFO: `/v3/projects/6a6237058b4c4fa9b12e608669243b1e` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:56.410394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6237058b4c4fa9b12e608669243b1e)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:56.412510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:56.466340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6237058b4c4fa9b12e608669243b1e', 'request_id': 'req-3c84b95f-1d41-4683-b5a6-1cedeeb47952'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.472658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6237058b4c4fa9b12e608669243b1e', 'request_id': 'req-3c84b95f-1d41-4683-b5a6-1cedeeb47952'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.481058 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6237058b4c4fa9b12e608669243b1e', 'request_id': 'req-3c84b95f-1d41-4683-b5a6-1cedeeb47952'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.492177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] The token cache is being invalidate because project 6a6237058b4c4fa9b12e608669243b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:56.492384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.493025 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.494651 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1312/2613] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:56 2021] DELETE /identity/v3/projects/6a6237058b4c4fa9b12e608669243b1e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:56.499288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:56.509875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c25-ad2f-4061-a648-65e95b29e094 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:56.569118 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:56.570060 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:56.570441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:56.570781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] PATH_INFO: `/v3/users/dd0a79ab0851427b81232c50a4e6a3a8` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:56.571989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0a79ab0851427b81232c50a4e6a3a8)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:56.573904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:56.628477 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0a79ab0851427b81232c50a4e6a3a8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.638698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0a79ab0851427b81232c50a4e6a3a8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.646195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0a79ab0851427b81232c50a4e6a3a8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.658378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0a79ab0851427b81232c50a4e6a3a8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.659087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-67a00d93-200a-44f8-a82a-6507293fa3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0a79ab0851427b81232c50a4e6a3a8'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:56.665768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1302/2614] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:56 2021] DELETE /identity/v3/users/dd0a79ab0851427b81232c50a4e6a3a8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:56.940096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:56.942284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:56.955817 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84b95f-1d41-4683-b5a6-1cedeeb47952 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.012318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.013180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.013462 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.013740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] PATH_INFO: `/v3/projects/3664970e1eb34fe9a16b706580aaadca` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.015054 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3664970e1eb34fe9a16b706580aaadca)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.016966 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.061355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3664970e1eb34fe9a16b706580aaadca', 'request_id': 'req-140cce1d-d803-49e3-9282-59fa91f4caf2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:57.067824 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3664970e1eb34fe9a16b706580aaadca', 'request_id': 'req-140cce1d-d803-49e3-9282-59fa91f4caf2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:57.075063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3664970e1eb34fe9a16b706580aaadca', 'request_id': 'req-140cce1d-d803-49e3-9282-59fa91f4caf2'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:57.085682 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] The token cache is being invalidate because project 3664970e1eb34fe9a16b706580aaadca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:57.085973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:57.086688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-140cce1d-d803-49e3-9282-59fa91f4caf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:57.088318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1313/2615] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:56 2021] DELETE /identity/v3/projects/3664970e1eb34fe9a16b706580aaadca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:10:57.094040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.094581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.094788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.113449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:57.114698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:57.172714 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1303/2616] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:10:57.181703 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.182280 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.182561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.201759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:57.203014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:57.211274 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1314/2617] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:57.215481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.225184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2621d-9c6c-405a-85e4-04cc3a0b00da None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.229829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.230535 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.230818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.231091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.231827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:10:57.232133 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.233722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.246039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1304/2618] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:10:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:10:57.250426 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.260498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb9419-6d92-4dcf-aa0c-9679e85ed1db None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.265133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.265789 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.266075 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.266383 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.267090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.269033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.296348 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1315/2619] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:10:57.301397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.312468 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b725f1c-d7ac-4300-848a-310d19330039 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.368132 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.368799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.369082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.369356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.370057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.372036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.392121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1305/2620] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:10:57.396209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.407291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da035a9-1279-4b8e-8204-d07c4e73b69b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.413709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.414410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.414693 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.414946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.415683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.417314 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.431972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1316/2621] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:10:57.434411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.445635 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f27e3-51d8-42d9-b3c1-8a7919a6f7cb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.450652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b1a6-49cd-4895-b729-05ff5606c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.451315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b1a6-49cd-4895-b729-05ff5606c0db admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.451582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b1a6-49cd-4895-b729-05ff5606c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.451856 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b1a6-49cd-4895-b729-05ff5606c0db admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.453139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b1a6-49cd-4895-b729-05ff5606c0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.454243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b1a6-49cd-4895-b729-05ff5606c0db admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.464971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1306/2622] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:10:57.469141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.479825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fbd04-3caf-4e28-92c0-c4b875209c2a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.488619 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.489820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.490098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.490447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] PATH_INFO: `/v3/projects/96cf7ad5b1e04903b75e4acff588e43a/users/5a066ce05bae4780a5f87e75e16d566c/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.509339 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cf7ad5b1e04903b75e4acff588e43a, user_id=5a066ce05bae4780a5f87e75e16d566c, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.512313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.529151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1317/2623] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:10:57 2021] PUT /identity/v3/projects/96cf7ad5b1e04903b75e4acff588e43a/users/5a066ce05bae4780a5f87e75e16d566c/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:57.541218 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d52af8-af35-4737-bd95-723911393243 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.541812 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d52af8-af35-4737-bd95-723911393243 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.542083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d52af8-af35-4737-bd95-723911393243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.578194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-84d52af8-af35-4737-bd95-723911393243 None None] MFA Rules not processed for user `5a066ce05bae4780a5f87e75e16d566c`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:57.578194 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-84d52af8-af35-4737-bd95-723911393243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:57.642522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1307/2624] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:57.647540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.710485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477798-4e92-4c32-89a0-32f0ae5fda0c admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.715223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.715871 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.716151 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.716424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.717141 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.719350 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.744884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1318/2625] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:10:57.748948 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d52af8-af35-4737-bd95-723911393243 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.760500 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d52af8-af35-4737-bd95-723911393243 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.835177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe6f6-fbe6-4f82-9e65-e2e90e4994e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.838314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe6f6-fbe6-4f82-9e65-e2e90e4994e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.838605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe6f6-fbe6-4f82-9e65-e2e90e4994e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.838880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe6f6-fbe6-4f82-9e65-e2e90e4994e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.839841 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe6f6-fbe6-4f82-9e65-e2e90e4994e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.841508 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe6f6-fbe6-4f82-9e65-e2e90e4994e8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.863586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1308/2626] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:10:57.867782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.873357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.873652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.873979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.879439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8283-c828-4389-86e9-ad28feef07fd admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.884622 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.885602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.885885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.886192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.886936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.888524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.893167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:57.894442 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:57.899139 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1319/2627] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:10:57.903661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.913570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f12b4-4060-4a30-9f3a-7cc5434c9372 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:57.918101 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:57.918986 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:57.919264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:57.919533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] PATH_INFO: `/v3/projects/40f7f69d569f4285a2101ab71a458e44/users/45f5d8e3993743439522ef29a3e18c9f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:57.934498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f7f69d569f4285a2101ab71a458e44, user_id=45f5d8e3993743439522ef29a3e18c9f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:57.937160 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:57.950086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1309/2628] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Dec 15 13:10:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:10:57.951784 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1320/2629] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:10:57 2021] PUT /identity/v3/projects/40f7f69d569f4285a2101ab71a458e44/users/45f5d8e3993743439522ef29a3e18c9f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:57.955591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.963322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:57.964979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:57.967377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00fd15-7452-411a-9085-e97e173cbbc6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:58.024038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:58.024705 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.024989 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.025264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.026001 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:58.027691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:58.034083 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056b98-efe7-436d-97a8-5821e400be46 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:58.037700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1310/2630] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:10:57 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:10:58.039439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:58.040108 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.040816 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.041100 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.041548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:58.052773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b08ad-e2ee-498b-900a-2cf3bf50910e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:58.057390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1451f-a8ce-4d33-bfce-ce1188609a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:58.058292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1451f-a8ce-4d33-bfce-ce1188609a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.058572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1451f-a8ce-4d33-bfce-ce1188609a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.058845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1451f-a8ce-4d33-bfce-ce1188609a54 admin admin] PATH_INFO: `/v3/projects/40f7f69d569f4285a2101ab71a458e44/users/45f5d8e3993743439522ef29a3e18c9f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.060840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1451f-a8ce-4d33-bfce-ce1188609a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f7f69d569f4285a2101ab71a458e44, user_id=45f5d8e3993743439522ef29a3e18c9f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:58.063571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1451f-a8ce-4d33-bfce-ce1188609a54 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:58.074969 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1311/2631] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:10:58 2021] PUT /identity/v3/projects/40f7f69d569f4285a2101ab71a458e44/users/45f5d8e3993743439522ef29a3e18c9f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:10:58.085898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.086208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.086476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.099007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:58.100603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:58.109451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1321/2632] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:10:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 15 13:10:58.112973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] MFA Rules not processed for user `45f5d8e3993743439522ef29a3e18c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:58.114120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:58.186112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1312/2633] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:58 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:10:58.197557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:58.199089 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:58.260633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e167d7-c30a-431f-b3c0-00aae8118a8d service swift] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:58.321677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:58.322662 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.323095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.323539 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.334768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:58.336708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:58.348759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1322/2634] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:58 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:58.422732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:58.433341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d9d68-c5eb-405b-a1d4-154e3b37eac4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:58.442410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36035c3f-c7e1-4722-86f4-5b7dafc05e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:58.443551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36035c3f-c7e1-4722-86f4-5b7dafc05e2d service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.444002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36035c3f-c7e1-4722-86f4-5b7dafc05e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.444349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36035c3f-c7e1-4722-86f4-5b7dafc05e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.509821 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36035c3f-c7e1-4722-86f4-5b7dafc05e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:58.511345 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36035c3f-c7e1-4722-86f4-5b7dafc05e2d service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:58.520996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1313/2635] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:58 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:58.808974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:58.888012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a313f-4a30-4621-b4fd-68d672ec4331 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:58.893144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:58.894592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.894874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.895146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] PATH_INFO: `/v3/users/5a066ce05bae4780a5f87e75e16d566c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:58.896416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a066ce05bae4780a5f87e75e16d566c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:58.898387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:58.946253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a066ce05bae4780a5f87e75e16d566c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:58.954090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a066ce05bae4780a5f87e75e16d566c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:58.962905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a066ce05bae4780a5f87e75e16d566c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:58.963993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a066ce05bae4780a5f87e75e16d566c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:58.975753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a066ce05bae4780a5f87e75e16d566c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:58.981981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1323/2636] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:58 2021] DELETE /identity/v3/users/5a066ce05bae4780a5f87e75e16d566c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:58.986459 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:58.986748 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:58.987022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:59.005390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:10:59.006658 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:59.075475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1314/2637] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:10:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:10:59.085553 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:59.087307 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:59.156200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f72a-9f1f-449b-af44-d6fbd3664d7a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:59.160341 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:59.160743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:59.161024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:59.161304 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:59.171133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:59.172690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:59.187271 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1324/2638] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:10:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:10:59.467183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:59.468788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:10:59.485603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea07ebd-9de2-4fd2-bdbf-82cb2506cf1c None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:59.492929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:59.494071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:59.494534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:59.494873 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] PATH_INFO: `/v3/projects/96cf7ad5b1e04903b75e4acff588e43a` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:59.496671 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cf7ad5b1e04903b75e4acff588e43a)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:59.499774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:59.565537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cf7ad5b1e04903b75e4acff588e43a', 'request_id': 'req-385c28d2-cde5-4b83-bbb5-0365563c1089'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.571852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cf7ad5b1e04903b75e4acff588e43a', 'request_id': 'req-385c28d2-cde5-4b83-bbb5-0365563c1089'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.580115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cf7ad5b1e04903b75e4acff588e43a', 'request_id': 'req-385c28d2-cde5-4b83-bbb5-0365563c1089'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.591847 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] The token cache is being invalidate because project 96cf7ad5b1e04903b75e4acff588e43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:10:59.592208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.593219 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.594828 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1315/2639] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:10:59 2021] DELETE /identity/v3/projects/96cf7ad5b1e04903b75e4acff588e43a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:10:59.599267 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:10:59.608916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3158a5-c438-4180-ae0a-eeea96e1a88f service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:10:59.664746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:10:59.665740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:10:59.666018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:10:59.666323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] PATH_INFO: `/v3/users/45f5d8e3993743439522ef29a3e18c9f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:10:59.667552 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f5d8e3993743439522ef29a3e18c9f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:10:59.669482 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:10:59.715735 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f5d8e3993743439522ef29a3e18c9f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.723935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f5d8e3993743439522ef29a3e18c9f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.731804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f5d8e3993743439522ef29a3e18c9f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.732538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f5d8e3993743439522ef29a3e18c9f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.745660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-33400d6c-8341-4834-b8ce-e9d38ffcc9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f5d8e3993743439522ef29a3e18c9f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:10:59.753812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1325/2640] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:10:59 2021] DELETE /identity/v3/users/45f5d8e3993743439522ef29a3e18c9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:11:00.097974 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.099478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:00.115460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c28d2-cde5-4b83-bbb5-0365563c1089 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.183274 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.184138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.184478 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.184695 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] PATH_INFO: `/v3/projects/40f7f69d569f4285a2101ab71a458e44` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.186097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f7f69d569f4285a2101ab71a458e44)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.188025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.236848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f7f69d569f4285a2101ab71a458e44', 'request_id': 'req-45f7c769-8f46-400a-b4b1-8478f6347e50'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:00.243861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f7f69d569f4285a2101ab71a458e44', 'request_id': 'req-45f7c769-8f46-400a-b4b1-8478f6347e50'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:00.251169 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f7f69d569f4285a2101ab71a458e44', 'request_id': 'req-45f7c769-8f46-400a-b4b1-8478f6347e50'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:00.263100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] The token cache is being invalidate because project 40f7f69d569f4285a2101ab71a458e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:11:00.263381 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:00.264021 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-45f7c769-8f46-400a-b4b1-8478f6347e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:00.265558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1316/2641] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:11:00 2021] DELETE /identity/v3/projects/40f7f69d569f4285a2101ab71a458e44 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:00.272900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.273384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.273480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.292358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:00.293830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:00.366969 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1326/2642] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:00.374943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.375234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.375507 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.396662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:00.397882 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:00.406240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1317/2643] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:00.410886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.420831 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277ac3d-adbf-48cc-9558-e74a021a08ce None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.426085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.426779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.427061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.427334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.428082 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:11:00.428387 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.429990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.442400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1327/2644] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:11:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:11:00.446917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.456799 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02f2f6-7af6-4cd9-b829-a5f3b98c26b4 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.461581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.462279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.462566 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.462838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.463554 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.465464 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.495511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1318/2645] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:11:00 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:00.499709 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.510782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2113c-fdd2-456f-b9e5-8c1af72b276f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.568300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.568984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.569264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.569538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.570272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.572998 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.596382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1328/2646] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:11:00 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:00.601013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.611572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f3c0e-f73c-4ec5-9064-6a195d177c5a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.616966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.617636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.617954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.618217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.618970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.620574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.632743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1319/2647] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:00.637196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.649423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686afd44-a609-4fe7-90db-5092e0ebfcb0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.654269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69537480-b9bf-495d-8eb1-4c7387ae25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.654956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537480-b9bf-495d-8eb1-4c7387ae25ac admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.655238 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537480-b9bf-495d-8eb1-4c7387ae25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.655514 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537480-b9bf-495d-8eb1-4c7387ae25ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.656261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69537480-b9bf-495d-8eb1-4c7387ae25ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.657922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69537480-b9bf-495d-8eb1-4c7387ae25ac admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.672618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1329/2648] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:00.673791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.684607 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae0415-a80c-4a4d-8662-5a3d16a16393 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.689445 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.690934 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.691223 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.691493 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] PATH_INFO: `/v3/projects/efe4d169051c40398cc0edaa91e35cab/users/9f896340a0d74db2851338abdd3a0c10/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.707960 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe4d169051c40398cc0edaa91e35cab, user_id=9f896340a0d74db2851338abdd3a0c10, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.710579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.727217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1320/2649] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:11:00 2021] PUT /identity/v3/projects/efe4d169051c40398cc0edaa91e35cab/users/9f896340a0d74db2851338abdd3a0c10/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:00.739672 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.740127 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.740456 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.771733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] MFA Rules not processed for user `9f896340a0d74db2851338abdd3a0c10`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:00.772977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:00.846533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1330/2650] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:00 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:00.855970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:00.857699 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:00.915427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a44ba-4fbd-45b2-a551-0d1ed276b45a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:00.919171 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea0e55-0885-468d-a17b-a8bd18a5377e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:00.919836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0e55-0885-468d-a17b-a8bd18a5377e service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:00.920120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0e55-0885-468d-a17b-a8bd18a5377e service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:00.920397 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0e55-0885-468d-a17b-a8bd18a5377e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:00.930056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea0e55-0885-468d-a17b-a8bd18a5377e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:00.931538 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea0e55-0885-468d-a17b-a8bd18a5377e service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:00.940968 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1321/2651] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:00 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:11:00.961030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:01.023997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d2b7f-a10e-451f-8f4d-d60ac5a5fc21 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:01.029822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:01.030744 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.031024 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.031292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] PATH_INFO: `/v3/users/9f896340a0d74db2851338abdd3a0c10` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.032593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f896340a0d74db2851338abdd3a0c10)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:01.035322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:01.088900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f896340a0d74db2851338abdd3a0c10'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.098771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f896340a0d74db2851338abdd3a0c10'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.108248 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f896340a0d74db2851338abdd3a0c10'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.109016 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f896340a0d74db2851338abdd3a0c10'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.122708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f896340a0d74db2851338abdd3a0c10'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.129814 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1331/2652] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:11:00 2021] DELETE /identity/v3/users/9f896340a0d74db2851338abdd3a0c10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:01.134391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.134685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.134966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.155905 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:01.157126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:01.242180 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1322/2653] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:11:01.248481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:01.249937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:01.309663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7d0ec-0fae-4cf2-a648-a387a43a5592 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:01.314256 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b41c3-64cd-4057-969d-b06edd3561be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:01.314961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b41c3-64cd-4057-969d-b06edd3561be service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.315275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b41c3-64cd-4057-969d-b06edd3561be service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.315573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b41c3-64cd-4057-969d-b06edd3561be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.325422 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b41c3-64cd-4057-969d-b06edd3561be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:01.326889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b41c3-64cd-4057-969d-b06edd3561be service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:01.336382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1332/2654] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:01.629900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:01.631522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:01.644887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4246e0-7408-481f-a99c-21290656c8f1 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:01.650281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:01.651225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.651513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.651789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] PATH_INFO: `/v3/projects/efe4d169051c40398cc0edaa91e35cab` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.653024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe4d169051c40398cc0edaa91e35cab)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:01.655268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:01.707385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe4d169051c40398cc0edaa91e35cab', 'request_id': 'req-c53385b8-c90a-4bd0-a995-54ffafbe3143'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.713976 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe4d169051c40398cc0edaa91e35cab', 'request_id': 'req-c53385b8-c90a-4bd0-a995-54ffafbe3143'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.722036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe4d169051c40398cc0edaa91e35cab', 'request_id': 'req-c53385b8-c90a-4bd0-a995-54ffafbe3143'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.732678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] The token cache is being invalidate because project efe4d169051c40398cc0edaa91e35cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:11:01.732964 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.733707 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c53385b8-c90a-4bd0-a995-54ffafbe3143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:01.735333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1323/2655] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:11:01 2021] DELETE /identity/v3/projects/efe4d169051c40398cc0edaa91e35cab => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:01.741818 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.742234 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.742587 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.762102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:01.763357 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:01.832193 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1333/2656] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:11:01.834597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.834887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.835167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.854332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:01.855556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:01.865387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1324/2657] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:01.869729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:01.880454 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e54d7-9a23-4127-857d-78702c02cc50 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:01.885420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:01.886084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.886393 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.886666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.887408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:11:01.887714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:01.889501 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:01.906509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1334/2658] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:11:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:11:01.907641 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:01.917143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97914ef-94b2-4f69-bb2a-58439370d920 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:01.921727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:01.922460 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:01.922743 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:01.923013 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:01.923741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:01.926383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:01.957228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1325/2659] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:11:01 2021] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:11:01.958384 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:01.968579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a647abe-aa5f-4378-a332-92b05e048f89 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.026044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.026583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.026950 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.027146 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.027865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.029830 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.051149 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1335/2660] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:11:01 2021] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:11:02.055340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:02.066390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc234-bec8-4f0c-8e17-dad209a1c041 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.071101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.071814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.072093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.072371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.073112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.074740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.086312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1326/2661] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:02.090495 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:02.101147 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27534514-e609-4378-8d43-ae8604648b1e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.106029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24945176-5269-4e92-9e06-9e346ec693b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.106806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945176-5269-4e92-9e06-9e346ec693b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.107088 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945176-5269-4e92-9e06-9e346ec693b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.107363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24945176-5269-4e92-9e06-9e346ec693b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.108148 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24945176-5269-4e92-9e06-9e346ec693b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.109782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24945176-5269-4e92-9e06-9e346ec693b0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.121214 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1336/2662] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:11:02.125495 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:02.136722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb2de-6092-4c1e-ab11-50324dcfe7f1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.141405 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.142331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.142615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.142885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] PATH_INFO: `/v3/projects/0b8c53a5927f413b83facc24f3ee2ebd/users/f4e673245f6e4e4789fb9b9a62d0e411/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.158677 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8c53a5927f413b83facc24f3ee2ebd, user_id=f4e673245f6e4e4789fb9b9a62d0e411, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.161413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.176402 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1327/2663] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:11:02 2021] PUT /identity/v3/projects/0b8c53a5927f413b83facc24f3ee2ebd/users/f4e673245f6e4e4789fb9b9a62d0e411/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:11:02.186487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.186741 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.187020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.222281 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] MFA Rules not processed for user `f4e673245f6e4e4789fb9b9a62d0e411`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:02.223698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:02.306264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1337/2664] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:02 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:02.337301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:02.339859 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:02.413105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18976d-3f89-41d8-8daf-49f577cd2e2e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.417308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814ad63-2f3f-4bf8-a479-5f66639c8757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.418129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814ad63-2f3f-4bf8-a479-5f66639c8757 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.418456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814ad63-2f3f-4bf8-a479-5f66639c8757 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.418740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814ad63-2f3f-4bf8-a479-5f66639c8757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.430158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814ad63-2f3f-4bf8-a479-5f66639c8757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.431642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814ad63-2f3f-4bf8-a479-5f66639c8757 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.444053 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1328/2665] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:02 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:02.459956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:02.522209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a80f-5c2d-48dd-a2b1-2ef0b9566607 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.527490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.528522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.528803 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.529096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] PATH_INFO: `/v3/users/f4e673245f6e4e4789fb9b9a62d0e411` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.530397 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e673245f6e4e4789fb9b9a62d0e411)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.532331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.580360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e673245f6e4e4789fb9b9a62d0e411'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:02.588250 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e673245f6e4e4789fb9b9a62d0e411'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:02.595663 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e673245f6e4e4789fb9b9a62d0e411'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:02.596826 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e673245f6e4e4789fb9b9a62d0e411'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:02.608285 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e673245f6e4e4789fb9b9a62d0e411'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:02.615316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1338/2666] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:11:02 2021] DELETE /identity/v3/users/f4e673245f6e4e4789fb9b9a62d0e411 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:02.623890 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.624258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.624632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.643407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:02.644629 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:02.703864 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1329/2667] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:02.714023 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:02.715530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:02.778487 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd644c4-294a-4652-a7d3-dba773fc44f5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:02.782067 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83568382-a949-4d8b-91f3-c8949f0f685e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:02.782737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83568382-a949-4d8b-91f3-c8949f0f685e service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:02.783020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83568382-a949-4d8b-91f3-c8949f0f685e service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:02.783290 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83568382-a949-4d8b-91f3-c8949f0f685e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:02.793538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83568382-a949-4d8b-91f3-c8949f0f685e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:02.794997 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83568382-a949-4d8b-91f3-c8949f0f685e service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:02.805890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1339/2668] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:03.094937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.096579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:03.108835 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334275a-b0ae-45fc-a5ce-dc8abde97dae None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.114346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.115252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.115596 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.115936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] PATH_INFO: `/v3/projects/0b8c53a5927f413b83facc24f3ee2ebd` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.117168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8c53a5927f413b83facc24f3ee2ebd)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.119104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.170400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8c53a5927f413b83facc24f3ee2ebd', 'request_id': 'req-58601377-18ec-473e-b49d-05d1c82bded1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:03.176576 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8c53a5927f413b83facc24f3ee2ebd', 'request_id': 'req-58601377-18ec-473e-b49d-05d1c82bded1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:03.185871 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8c53a5927f413b83facc24f3ee2ebd', 'request_id': 'req-58601377-18ec-473e-b49d-05d1c82bded1'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:03.201775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] The token cache is being invalidate because project 0b8c53a5927f413b83facc24f3ee2ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:11:03.202173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:03.202750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-58601377-18ec-473e-b49d-05d1c82bded1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:03.204655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1330/2669] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:11:03 2021] DELETE /identity/v3/projects/0b8c53a5927f413b83facc24f3ee2ebd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:03.211029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.211375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.211659 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.230846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:03.232251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:03.295616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1340/2670] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:03.304529 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.304815 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.305093 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.325594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:03.326985 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:03.335806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1331/2671] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:03.340072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.350099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03765a8-b301-4143-b2e1-32092c1c08cc None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.354738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.355394 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.355671 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.355939 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.356679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:11:03.356983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.359031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.374308 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1341/2672] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:11:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:11:03.375808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.386589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33460c88-f34b-4f3f-84ab-5d73234d6dda None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.391283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.391947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.392230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.392506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.393283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.395747 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.421408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1332/2673] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:11:03 2021] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:03.425489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.436020 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e87920-c278-4e2e-9592-29c282c025c3 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.515499 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.516173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.516571 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.516905 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.517643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.520257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.543098 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1342/2674] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:11:03 2021] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:03.551243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.562314 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486a22-b2f9-43ef-885d-51d017e73248 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.569298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.570136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.570451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.570916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.571876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.573761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.585155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1333/2675] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:03.589171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.601055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcf90b-ae4b-477d-a7fe-f93e1c53ac16 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.606029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccef0f4-ffc1-44b9-a652-311e2c0f75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.606798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccef0f4-ffc1-44b9-a652-311e2c0f75ce admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.607170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccef0f4-ffc1-44b9-a652-311e2c0f75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.607477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccef0f4-ffc1-44b9-a652-311e2c0f75ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.608777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccef0f4-ffc1-44b9-a652-311e2c0f75ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.610653 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccef0f4-ffc1-44b9-a652-311e2c0f75ce admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.622330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1343/2676] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:03.626582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.639904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ba3d-aac2-4981-a744-414953ad3749 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.646035 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.647042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.647325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.647693 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] PATH_INFO: `/v3/projects/e45e83834e6e43079a994c31039f65dc/users/db8f447440254f4598d0773e967748e0/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.664631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e83834e6e43079a994c31039f65dc, user_id=db8f447440254f4598d0773e967748e0, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.667591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.683309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1334/2677] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:11:03 2021] PUT /identity/v3/projects/e45e83834e6e43079a994c31039f65dc/users/db8f447440254f4598d0773e967748e0/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:03.693639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.693921 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.694226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.726035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] MFA Rules not processed for user `db8f447440254f4598d0773e967748e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:03.727293 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:03.792330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1344/2678] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:03 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:03.802927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.805163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:03.864152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90a4e3-5f94-4986-8634-dfcd487ae578 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.867925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a1b7c-9ae2-4c01-a046-839a95e9d9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.868572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1b7c-9ae2-4c01-a046-839a95e9d9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.868854 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1b7c-9ae2-4c01-a046-839a95e9d9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.869135 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1b7c-9ae2-4c01-a046-839a95e9d9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.878665 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a1b7c-9ae2-4c01-a046-839a95e9d9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.880113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a1b7c-9ae2-4c01-a046-839a95e9d9b8 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:03.889579 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1335/2679] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:03 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:03.915090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:03.977777 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3a675-ce24-43d0-955f-20608fd0846d None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:03.982708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:03.983654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:03.983931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:03.984201 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] PATH_INFO: `/v3/users/db8f447440254f4598d0773e967748e0` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:03.985439 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8f447440254f4598d0773e967748e0)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:03.987948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:04.036877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8f447440254f4598d0773e967748e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.045690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8f447440254f4598d0773e967748e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.054557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8f447440254f4598d0773e967748e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.055269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8f447440254f4598d0773e967748e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.067055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8f447440254f4598d0773e967748e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.073253 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1345/2680] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:11:03 2021] DELETE /identity/v3/users/db8f447440254f4598d0773e967748e0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:04.077556 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1340438-46fd-4809-8657-4132efc57092 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.077842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1340438-46fd-4809-8657-4132efc57092 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.078115 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1340438-46fd-4809-8657-4132efc57092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.095085 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c1340438-46fd-4809-8657-4132efc57092 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:04.096939 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c1340438-46fd-4809-8657-4132efc57092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:04.159780 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1336/2681] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:04.169443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:04.171198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:04.233074 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2bf2c-ea16-4d20-a1dd-f3b1b8f1d37f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:04.237605 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa526e-e563-4188-be98-c8acd9b6d1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:04.238313 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa526e-e563-4188-be98-c8acd9b6d1bb service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.238594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa526e-e563-4188-be98-c8acd9b6d1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.238867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa526e-e563-4188-be98-c8acd9b6d1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.248782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa526e-e563-4188-be98-c8acd9b6d1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:04.250405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa526e-e563-4188-be98-c8acd9b6d1bb service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:04.261701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1346/2682] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:04.535384 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1340438-46fd-4809-8657-4132efc57092 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:04.536894 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c1340438-46fd-4809-8657-4132efc57092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:04.550359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1340438-46fd-4809-8657-4132efc57092 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:04.554990 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:04.556090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.556369 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.556646 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] PATH_INFO: `/v3/projects/e45e83834e6e43079a994c31039f65dc` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.557857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45e83834e6e43079a994c31039f65dc)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:04.559930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:04.613177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45e83834e6e43079a994c31039f65dc', 'request_id': 'req-6d656ffe-42eb-4c9d-a200-98501a66709b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.620346 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45e83834e6e43079a994c31039f65dc', 'request_id': 'req-6d656ffe-42eb-4c9d-a200-98501a66709b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.628857 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45e83834e6e43079a994c31039f65dc', 'request_id': 'req-6d656ffe-42eb-4c9d-a200-98501a66709b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.640827 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] The token cache is being invalidate because project e45e83834e6e43079a994c31039f65dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:11:04.641229 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.641891 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6d656ffe-42eb-4c9d-a200-98501a66709b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:11:04.643725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1337/2683] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:11:04 2021] DELETE /identity/v3/projects/e45e83834e6e43079a994c31039f65dc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:04.649437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.649898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.649981 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.670196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:04.671811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:04.746516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1347/2684] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:04.755301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.756456 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.756973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.785078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:04.787181 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:04.798284 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1338/2685] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:04.802962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:04.817793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2671270-7cf9-4a18-b59d-56952d8cd869 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:04.822616 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:04.823289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.823569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.823839 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.824595 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:11:04.824897 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:04.826530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:04.838573 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1348/2686] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:11:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 15 13:11:04.842861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:04.853238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683f467-1250-4a18-acd4-94137f8f70ca None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:04.858479 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:04.859145 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.859425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.859698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.860419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:04.862937 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:04.894139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1339/2687] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:11:04 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:04.895829 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:04.906062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2665dd-9fd6-44af-8ed4-ee1c89f53bae admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:04.962400 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:04.963064 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:04.963343 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:04.963610 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:04.964312 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:04.966254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:04.989420 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1349/2688] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:11:04 2021] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:04.993539 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:05.004183 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abaca5-d123-481e-b696-43eb674eb4b6 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:05.009230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:05.010086 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:05.010437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:05.010851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:05.011774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:05.013620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:05.024616 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1340/2689] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:05.028440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:05.039047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc662-0377-427f-b012-0ca063888be5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:05.044277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe486a-52ee-4731-a2de-7d709b3696a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:05.044962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe486a-52ee-4731-a2de-7d709b3696a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:05.045263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe486a-52ee-4731-a2de-7d709b3696a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:05.045675 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe486a-52ee-4731-a2de-7d709b3696a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:05.046766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe486a-52ee-4731-a2de-7d709b3696a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:05.048365 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe486a-52ee-4731-a2de-7d709b3696a4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:05.059453 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1350/2690] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:05.063586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:05.073973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495f903-9cc1-4152-bf04-383cd63d4df4 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:05.079951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:05.080875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:05.081152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:05.081426 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] PATH_INFO: `/v3/projects/85b5372522d64067b34faa325b4dc400/users/913f4595b6444821801332dacab3c616/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:05.097365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b5372522d64067b34faa325b4dc400, user_id=913f4595b6444821801332dacab3c616, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:05.100101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:05.114466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1341/2691] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:11:05 2021] PUT /identity/v3/projects/85b5372522d64067b34faa325b4dc400/users/913f4595b6444821801332dacab3c616/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:11:05.120779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ad65b-ccba-4e65-a51a-f26280dc3d11 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:05.121063 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ad65b-ccba-4e65-a51a-f26280dc3d11 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:05.121334 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ad65b-ccba-4e65-a51a-f26280dc3d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:05.140061 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-7c6ad65b-ccba-4e65-a51a-f26280dc3d11 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:05.141315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-7c6ad65b-ccba-4e65-a51a-f26280dc3d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:05.203318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1351/2692] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:05.213308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:05.215205 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:05.274103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70f4b9-4b8d-4040-9355-f92873e27f00 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:05.277833 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:05.278557 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:05.278888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:05.279158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:05.289359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:05.290760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:05.301475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1342/2693] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:10.491612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413788-134e-484d-98bd-a0fee11029bb None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.492232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413788-134e-484d-98bd-a0fee11029bb None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.492232 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413788-134e-484d-98bd-a0fee11029bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.523392 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-38413788-134e-484d-98bd-a0fee11029bb None None] MFA Rules not processed for user `913f4595b6444821801332dacab3c616`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:10.524742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-38413788-134e-484d-98bd-a0fee11029bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:10.591194 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1352/2694] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:10.595606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:10.605358 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ea7b9-96fc-4618-9812-c01750d013b8 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:10.609967 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:10.610668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.610945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.611268 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.612435 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:10.614378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:10.640583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1343/2695] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:11:10 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:10.644540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38413788-134e-484d-98bd-a0fee11029bb None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:10.655751 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38413788-134e-484d-98bd-a0fee11029bb None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:10.716217 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:10.716904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.717185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.717459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.718211 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:10.720316 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:10.744674 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1353/2696] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:11:10 2021] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:11:10.745885 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:10.757112 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955a001-3fb6-4521-94d0-0d9f283bcffc admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:10.762458 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:10.763195 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.763480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.763753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.764494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:10.766122 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:10.777105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1344/2697] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:10.781329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:10.792060 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725606b6-e69b-415e-9bf8-5632b9a59dd9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:10.796701 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:10.797570 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.797843 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.798111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] PATH_INFO: `/v3/projects/155236ceae63437faf4e20d49482f67d/users/ff750fad1f32481b983287f47b9931a7/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.815943 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155236ceae63437faf4e20d49482f67d, user_id=ff750fad1f32481b983287f47b9931a7, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:10.818635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:10.832196 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1354/2698] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:11:10 2021] PUT /identity/v3/projects/155236ceae63437faf4e20d49482f67d/users/ff750fad1f32481b983287f47b9931a7/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:11:10.836272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:10.848124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e885cb-1b65-4460-af58-88a34498cf59 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:10.906075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeed5e9-1adb-4fbb-8898-7a8c39079f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:10.906970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed5e9-1adb-4fbb-8898-7a8c39079f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.907413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed5e9-1adb-4fbb-8898-7a8c39079f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.907688 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed5e9-1adb-4fbb-8898-7a8c39079f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.908925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeed5e9-1adb-4fbb-8898-7a8c39079f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:10.910601 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeed5e9-1adb-4fbb-8898-7a8c39079f52 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:10.921228 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1345/2699] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:11:10 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:11:10.926344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:10.936962 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063374-7282-432c-baa0-bb573a4fb8c8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:10.942533 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:10.943433 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:10.943698 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:10.943972 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] PATH_INFO: `/v3/projects/155236ceae63437faf4e20d49482f67d/users/ff750fad1f32481b983287f47b9931a7/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:10.945968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155236ceae63437faf4e20d49482f67d, user_id=ff750fad1f32481b983287f47b9931a7, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:10.948639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:10.959927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1355/2700] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:11:10 2021] PUT /identity/v3/projects/155236ceae63437faf4e20d49482f67d/users/ff750fad1f32481b983287f47b9931a7/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:11:15.511723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3952-9ac8-4e42-91dc-f790e9bacecd None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:15.512241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3952-9ac8-4e42-91dc-f790e9bacecd None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:15.515642 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3952-9ac8-4e42-91dc-f790e9bacecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:15.542325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2aea3952-9ac8-4e42-91dc-f790e9bacecd None None] MFA Rules not processed for user `eb5d649917c74d81b0c2fad7c2ba1028`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:15.543732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2aea3952-9ac8-4e42-91dc-f790e9bacecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:15.623432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1346/2701] 10.222.0.57 () {58 vars in 967 bytes} [Wed Dec 15 13:11:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:15.640133 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:15.643006 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:15.727288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7a7a-db26-4753-978e-12647a916f27 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:15.733177 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eca15cf4b614f908d1e47baecadf6ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:15.733929 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:15.734581 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:15.734940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:15.744538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:15.746568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:15.757412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1356/2702] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Dec 15 13:11:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 15 13:11:15.944217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d476-a771-4ce3-806a-08f6dcbbbdeb None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:15.944217 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d476-a771-4ce3-806a-08f6dcbbbdeb None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:15.944503 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739d476-a771-4ce3-806a-08f6dcbbbdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:15.982344 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1739d476-a771-4ce3-806a-08f6dcbbbdeb None None] MFA Rules not processed for user `ff750fad1f32481b983287f47b9931a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:15.983547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1739d476-a771-4ce3-806a-08f6dcbbbdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:16.128213 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1347/2703] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:15 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:16.136747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:16.138853 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:16.240625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784d16-fab6-4db5-a951-e5a3b2cdff40 service swift] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:16.249505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:16.250223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:16.250513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:16.250792 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:16.335299 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:16.336923 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:16.348734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1357/2704] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:16 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:11:33.735418 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:33.735965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:33.735965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:33.754466 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] MFA Rules not processed for user `913f4595b6444821801332dacab3c616`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:11:33.755669 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:33.762849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1348/2705] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:11:33 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:11:49.904301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:49.961278 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617bae2-c362-4870-9075-78e9b2b1e296 service nova] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:49.964927 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:49.965561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:49.965838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:49.966109 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:49.975330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:49.976756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:49.986059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1358/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:49 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:11:57.888855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:11:57.899534 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c74e8a-61fe-4c16-b1d4-f39cbf42f2be None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:11:57.903786 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:11:57.904427 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:11:57.904708 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:11:57.904981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:11:57.906975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:11:57.970324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:11:57.972298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:11:57.982771 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1349/2707] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:11:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:00.940389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:00.942012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:00.959207 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2fb1-e836-4970-9627-87bdb1e8cc00 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:00.963919 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:00.964820 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:00.965130 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:00.965519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] PATH_INFO: `/v3/users/a1431bb04bd14db986edcf8931bc2210` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:00.966973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1431bb04bd14db986edcf8931bc2210)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:00.970294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.018200 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1431bb04bd14db986edcf8931bc2210'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.025786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1431bb04bd14db986edcf8931bc2210'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.032646 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1431bb04bd14db986edcf8931bc2210'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.033292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1431bb04bd14db986edcf8931bc2210'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.044717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-c1cc7b1f-a3e8-4efc-856a-3947a59f8f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1431bb04bd14db986edcf8931bc2210'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.050926 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1359/2708] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:00 2021] DELETE /identity/v3/users/a1431bb04bd14db986edcf8931bc2210 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:01.236749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.248848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa07efc-d9dd-4bc5-949d-f10caffa6893 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.309626 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.310606 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.310996 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.311438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] PATH_INFO: `/v3/projects/9fda976fb52842e28027e89e4d6752fe` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.313374 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fda976fb52842e28027e89e4d6752fe)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.315306 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.360513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fda976fb52842e28027e89e4d6752fe', 'request_id': 'req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.367623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fda976fb52842e28027e89e4d6752fe', 'request_id': 'req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.374800 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fda976fb52842e28027e89e4d6752fe', 'request_id': 'req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.386068 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] The token cache is being invalidate because project 9fda976fb52842e28027e89e4d6752fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:01.386380 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.387014 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-d3d73339-e43e-40e7-84aa-03aa8e0d2f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:01.388547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1350/2709] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:01 2021] DELETE /identity/v3/projects/9fda976fb52842e28027e89e4d6752fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:01.394275 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.394637 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.395014 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.412170 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:01.413362 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:01.474405 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1360/2710] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:12:01.482764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.483073 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.483348 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.502733 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:01.503932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:01.512065 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1351/2711] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:01.516410 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.525990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321075c-ae90-4ee4-bd71-c97f5cc2e0b7 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.532641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.533315 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.533591 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.533863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.534838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:12:01.535145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.536801 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.549489 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1361/2712] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:12:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:12:01.553877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.563999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3562-34f6-4173-b19b-df3fac09b487 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.568700 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.569355 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.569662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.570038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.570657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.572555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.600474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1352/2713] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:01 2021] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:12:01.604638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.615849 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464feefa-fa8f-436f-9766-eabcf914b949 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.670874 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.671538 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.672323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.672592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.673295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.675257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.696150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1362/2714] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:01 2021] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:01.699753 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.709918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e29b0-7262-4ae7-8402-25cc0fc91a31 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.715101 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.715768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.716050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.716323 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.717092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.719388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.730258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1353/2715] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:01.734721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.744909 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95617e-7671-4809-8963-cad624bacad9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.749640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d74c3c-988a-4a92-b3ff-31df04f251e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.750344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d74c3c-988a-4a92-b3ff-31df04f251e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.750627 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d74c3c-988a-4a92-b3ff-31df04f251e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.750904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d74c3c-988a-4a92-b3ff-31df04f251e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.751647 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d74c3c-988a-4a92-b3ff-31df04f251e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.753252 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d74c3c-988a-4a92-b3ff-31df04f251e4 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.764071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1363/2716] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:01.768281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.778966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7ec6-d0fd-4b00-ae96-97e77eb90c94 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.784176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.785061 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.785340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.785618 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] PATH_INFO: `/v3/projects/af241269dfa040d380b6257976997cd3/users/d715198ccb0b4a9994a0779fcd342694/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.801849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af241269dfa040d380b6257976997cd3, user_id=d715198ccb0b4a9994a0779fcd342694, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.804571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:01.818876 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1354/2717] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:01 2021] PUT /identity/v3/projects/af241269dfa040d380b6257976997cd3/users/d715198ccb0b4a9994a0779fcd342694/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:01.824166 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498b9d-0607-430a-98c1-2c9cdfb771d8 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.824459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498b9d-0607-430a-98c1-2c9cdfb771d8 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.824737 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac498b9d-0607-430a-98c1-2c9cdfb771d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.844264 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ac498b9d-0607-430a-98c1-2c9cdfb771d8 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:01.845492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ac498b9d-0607-430a-98c1-2c9cdfb771d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:01.904961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1364/2718] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:01.917600 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:01.919400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:01.975471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c194cde-e278-44ee-a6b5-f7efc1099ad9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:01.979175 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:01.979823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:01.980104 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:01.980433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:01.990367 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:01.991813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:02.001471 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1355/2719] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:02.609865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:02.610455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:02.610455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:02.637300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] MFA Rules not processed for user `d715198ccb0b4a9994a0779fcd342694`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:02.638557 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:02.702171 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1365/2720] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:02 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:02.707146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:02.716789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cac47-b66b-4579-a681-df297d87100c service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:02.721432 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:02.722077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:02.722403 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:02.722680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:02.723383 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:02.725272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:02.750673 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1356/2721] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:02 2021] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:02.754648 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:02.766078 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e0f99-0426-4b9a-898e-7c89e52a1b8a None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:02.821374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:02.822029 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:02.822338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:02.822612 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:02.823323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:02.825246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:02.844746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1366/2722] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:02 2021] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:02.848410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:02.858858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17b07-5fe5-4536-80fb-27b3ce7ef203 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:02.864078 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:02.864756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:02.865036 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:02.865311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:02.866050 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:02.867869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:02.879942 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1357/2723] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:12:02.884413 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:02.894095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739e249-f54f-48bd-a9be-5d32e3d45a7b admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:02.898704 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:02.899561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:02.899838 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:02.900107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] PATH_INFO: `/v3/projects/57d1d5bf26c54890a4ca8333e8e4e839/users/2c64f0e05684468f8c59b6c1ed5808a9/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:02.914567 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d1d5bf26c54890a4ca8333e8e4e839, user_id=2c64f0e05684468f8c59b6c1ed5808a9, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:02.917258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:02.930225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1367/2724] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:02 2021] PUT /identity/v3/projects/57d1d5bf26c54890a4ca8333e8e4e839/users/2c64f0e05684468f8c59b6c1ed5808a9/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:02.934063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:02.944431 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c550131-a60f-4974-aef9-677852a61812 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:02.997536 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b4c18-a7cb-4a0c-8981-2fb3461a6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:02.998210 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4c18-a7cb-4a0c-8981-2fb3461a6dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:02.998494 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4c18-a7cb-4a0c-8981-2fb3461a6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:02.998764 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4c18-a7cb-4a0c-8981-2fb3461a6dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:02.999481 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4c18-a7cb-4a0c-8981-2fb3461a6dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:03.001684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4c18-a7cb-4a0c-8981-2fb3461a6dd1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:03.011238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1358/2725] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:02 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:03.015263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:03.025244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654e7cb-1dea-449d-86c9-f1c989eea3bb admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:03.029806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:03.030715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:03.031038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:03.031301 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] PATH_INFO: `/v3/projects/57d1d5bf26c54890a4ca8333e8e4e839/users/2c64f0e05684468f8c59b6c1ed5808a9/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:03.033382 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d1d5bf26c54890a4ca8333e8e4e839, user_id=2c64f0e05684468f8c59b6c1ed5808a9, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:03.036306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:03.046246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1368/2726] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:03 2021] PUT /identity/v3/projects/57d1d5bf26c54890a4ca8333e8e4e839/users/2c64f0e05684468f8c59b6c1ed5808a9/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:03.629752 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:03.630044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:03.630350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:03.656491 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] MFA Rules not processed for user `2c64f0e05684468f8c59b6c1ed5808a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:03.658057 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:03.726296 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1359/2727] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:03 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:04.924289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:04.984549 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902ec41-5713-49d7-a6d9-9d392b77b0b7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:04.989102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:04.989955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:04.990266 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:04.990540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] PATH_INFO: `/v3/users/d715198ccb0b4a9994a0779fcd342694` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:04.991729 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d715198ccb0b4a9994a0779fcd342694)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:04.993754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:05.037747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd715198ccb0b4a9994a0779fcd342694'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.045215 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd715198ccb0b4a9994a0779fcd342694'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.051999 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd715198ccb0b4a9994a0779fcd342694'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.052630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd715198ccb0b4a9994a0779fcd342694'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.064625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd715198ccb0b4a9994a0779fcd342694'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.070545 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1369/2728] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:04 2021] DELETE /identity/v3/users/d715198ccb0b4a9994a0779fcd342694 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:05.232663 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:05.243944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309c496-b751-449f-bc84-e6765bedb320 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:05.300944 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:05.301798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:05.302079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:05.302410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] PATH_INFO: `/v3/projects/af241269dfa040d380b6257976997cd3` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:05.303603 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af241269dfa040d380b6257976997cd3)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:05.305577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:05.350387 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af241269dfa040d380b6257976997cd3', 'request_id': 'req-b8f9dc9b-5492-4b6c-b374-712a25305a28'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.356141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af241269dfa040d380b6257976997cd3', 'request_id': 'req-b8f9dc9b-5492-4b6c-b374-712a25305a28'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.363634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af241269dfa040d380b6257976997cd3', 'request_id': 'req-b8f9dc9b-5492-4b6c-b374-712a25305a28'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.373234 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] The token cache is being invalidate because project af241269dfa040d380b6257976997cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:05.373515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.374128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.376286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1360/2729] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:05 2021] DELETE /identity/v3/projects/af241269dfa040d380b6257976997cd3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:05.380396 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:05.382044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:05.394810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5fae9-98b8-488d-8d63-0ebbf9a28e53 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:05.452432 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:05.453309 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:05.453592 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:05.453872 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] PATH_INFO: `/v3/users/2c64f0e05684468f8c59b6c1ed5808a9` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:05.455123 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c64f0e05684468f8c59b6c1ed5808a9)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:05.457255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:05.505734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c64f0e05684468f8c59b6c1ed5808a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.513051 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c64f0e05684468f8c59b6c1ed5808a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.519953 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c64f0e05684468f8c59b6c1ed5808a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.520620 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c64f0e05684468f8c59b6c1ed5808a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.532852 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6e72c14e-58b1-4069-b3c3-10986a7f1cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c64f0e05684468f8c59b6c1ed5808a9'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.538718 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1370/2730] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:05 2021] DELETE /identity/v3/users/2c64f0e05684468f8c59b6c1ed5808a9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:05.865368 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:05.866887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:05.879510 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9dc9b-5492-4b6c-b374-712a25305a28 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:05.938643 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:05.939524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:05.939802 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:05.940074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] PATH_INFO: `/v3/projects/57d1d5bf26c54890a4ca8333e8e4e839` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:05.941256 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d1d5bf26c54890a4ca8333e8e4e839)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:05.943185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:05.990225 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d1d5bf26c54890a4ca8333e8e4e839', 'request_id': 'req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:05.996312 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d1d5bf26c54890a4ca8333e8e4e839', 'request_id': 'req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:06.003102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d1d5bf26c54890a4ca8333e8e4e839', 'request_id': 'req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:06.013279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] The token cache is being invalidate because project 57d1d5bf26c54890a4ca8333e8e4e839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:06.013560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:06.014203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-96c15765-b6ba-4ba1-8ff9-5eb0cbaeea90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:06.016279 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1361/2731] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:05 2021] DELETE /identity/v3/projects/57d1d5bf26c54890a4ca8333e8e4e839 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:06.021935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.022423 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.022517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.040617 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:06.041808 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:06.100319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1371/2732] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:06.109287 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.109577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.109853 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.127947 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:06.129129 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:06.137231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1362/2733] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:06.141878 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.151249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285b59c-706d-4734-8e5a-c07a33c46ca9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.155859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.157007 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.157358 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.157628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.158403 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:12:06.158714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.160302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.171898 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1372/2734] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:12:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:12:06.175877 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.184795 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d18504-55c7-49bb-8006-f9830f4fe7e6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.189569 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.190227 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.190505 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.190776 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.191522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.193395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.217808 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1363/2735] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:06.222504 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.232086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9109e0-045b-4060-945e-9f8d437d09a5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.285738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.286342 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.286625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.286899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.287602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.289500 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.312522 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1373/2736] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:12:06.313685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.323935 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3baf-489b-44f8-95c5-0e1d838d445b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.329113 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.329758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.330045 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.330372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.331100 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.332680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.342655 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1364/2737] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:06.346661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.356399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3aca-4838-462d-975c-4f9708db6400 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.360990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8561ed-8bf9-440c-ad5e-6d42e6f4505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.361630 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8561ed-8bf9-440c-ad5e-6d42e6f4505f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.361911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8561ed-8bf9-440c-ad5e-6d42e6f4505f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.362220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8561ed-8bf9-440c-ad5e-6d42e6f4505f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.362952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8561ed-8bf9-440c-ad5e-6d42e6f4505f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.364526 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8561ed-8bf9-440c-ad5e-6d42e6f4505f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.374189 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1374/2738] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:06.378451 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.388546 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3ef6c-4bde-47a2-a244-47352e3868e1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.393840 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.394817 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.395095 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.395363 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] PATH_INFO: `/v3/projects/1dfdac330def4480ab17269f47290375/users/fa0d026a43ba4af4923c18693f949be9/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.409335 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfdac330def4480ab17269f47290375, user_id=fa0d026a43ba4af4923c18693f949be9, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.412029 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.424031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1365/2739] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:06 2021] PUT /identity/v3/projects/1dfdac330def4480ab17269f47290375/users/fa0d026a43ba4af4923c18693f949be9/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:06.434132 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.434446 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.434754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.461044 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] MFA Rules not processed for user `fa0d026a43ba4af4923c18693f949be9`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:06.462287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:06.522204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1375/2740] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:06.526692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.585056 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89adfa-2a8d-4d5c-89b5-94491755e170 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.589590 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.590263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.590548 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.590826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.591541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.593454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.619150 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1366/2741] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:06.623117 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.634294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e5238-9ff6-4c6e-9a52-46c467b441a0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.690254 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.690911 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.691192 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.691465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.692169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.694071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.713451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1376/2742] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:12:06.716861 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.727048 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928a6df-49d1-4f25-8690-3a2dd3bac17b admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.731916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.732570 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.732851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.733126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.734412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.736020 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.747273 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1367/2743] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:06.751756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.761958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2a7c4-0542-41dd-a7c5-d1b9f2bf443a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.766556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e14be-77a2-4363-af2c-033a78433ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.767198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e14be-77a2-4363-af2c-033a78433ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.767479 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e14be-77a2-4363-af2c-033a78433ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.767766 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e14be-77a2-4363-af2c-033a78433ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.768492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e14be-77a2-4363-af2c-033a78433ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.770053 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e14be-77a2-4363-af2c-033a78433ccd admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.780287 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1377/2744] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:12:06.783379 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.792986 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daf475-d583-4c99-9a1f-2ccc10335fda admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:06.798176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:06.799070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.799354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.799631 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] PATH_INFO: `/v3/projects/c902fc8bee1a4672aa9d7b7b0cebfaf6/users/d3ba2dcc7bf54c17845a893dbd07b855/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.818438 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c902fc8bee1a4672aa9d7b7b0cebfaf6, user_id=d3ba2dcc7bf54c17845a893dbd07b855, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:06.821083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:06.834166 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1368/2745] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:06 2021] PUT /identity/v3/projects/c902fc8bee1a4672aa9d7b7b0cebfaf6/users/d3ba2dcc7bf54c17845a893dbd07b855/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:06.844303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:06.844530 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:06.844805 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:06.870763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] MFA Rules not processed for user `d3ba2dcc7bf54c17845a893dbd07b855`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:06.871976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:06.934497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1378/2746] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:06.939605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:06.998595 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0be3a6-639f-47e9-bdc8-7a7f4e5f5467 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.003281 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.003925 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.004242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.004553 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.005258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.007416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.032156 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1369/2747] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:06 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:07.036311 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.047258 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8c600-2d77-4835-8294-919d37d91ffd None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.099178 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.099757 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.100033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.100300 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.101000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.102936 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.121554 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1379/2748] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:07 2021] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:07.125615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.136788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9ceb7-e001-4012-a8ce-845fcbf9f679 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.141408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.142052 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.142360 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.142637 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.143370 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.144981 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.155079 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1370/2749] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:07.159823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.169421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b16c3-8f0b-4ed2-909a-3a483dfa1ec9 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.174643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.175510 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.175791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.176070 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] PATH_INFO: `/v3/projects/46ea536d21994105be5960178b0d2a3f/users/b6a1be17c9e54b9784d784462e182b6f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.190090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ea536d21994105be5960178b0d2a3f, user_id=b6a1be17c9e54b9784d784462e182b6f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.192754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.205641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1380/2750] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:07 2021] PUT /identity/v3/projects/46ea536d21994105be5960178b0d2a3f/users/b6a1be17c9e54b9784d784462e182b6f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:07.209513 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.219634 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f01209-8eaf-49c1-872e-0e4397e93907 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.273088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf3375-c521-4886-992b-f956af67ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.273740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf3375-c521-4886-992b-f956af67ac99 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.274024 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf3375-c521-4886-992b-f956af67ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.274340 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf3375-c521-4886-992b-f956af67ac99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.275070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf3375-c521-4886-992b-f956af67ac99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.276689 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf3375-c521-4886-992b-f956af67ac99 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.286773 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1371/2751] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:07 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:07.290896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.301421 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb092a-7894-404b-96ba-f75ce3802fc2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.306527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.307626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.308031 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.308381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] PATH_INFO: `/v3/projects/46ea536d21994105be5960178b0d2a3f/users/b6a1be17c9e54b9784d784462e182b6f/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.311095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ea536d21994105be5960178b0d2a3f, user_id=b6a1be17c9e54b9784d784462e182b6f, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.313708 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.323918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1381/2752] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:07 2021] PUT /identity/v3/projects/46ea536d21994105be5960178b0d2a3f/users/b6a1be17c9e54b9784d784462e182b6f/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:07.335392 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.335872 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.335998 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.362530 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] MFA Rules not processed for user `b6a1be17c9e54b9784d784462e182b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:07.363644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:07.429480 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1372/2753] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:07 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:07.440890 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.443416 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:07.497918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5883fc-c971-48e1-828c-0014b72ee824 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.501556 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.502210 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.502492 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.502762 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:07.511594 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:07.513005 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:07.522443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1382/2754] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:07 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:07.960568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:07.961975 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:07.973449 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0776077-e349-49c3-b3c2-23d5b645237b None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:07.977026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:07.977657 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:07.977938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:07.978245 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:08.033134 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:08.034612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:08.043207 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1373/2755] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:07 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:11.964679 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:11.973604 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad1540-ef20-4aa8-923f-1a8393413758 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:11.977161 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498f622-28b2-43c2-a09d-8038921daa6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:11.977782 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f622-28b2-43c2-a09d-8038921daa6a service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:11.978062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f622-28b2-43c2-a09d-8038921daa6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:11.978369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498f622-28b2-43c2-a09d-8038921daa6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:12.032442 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498f622-28b2-43c2-a09d-8038921daa6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:12.033932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498f622-28b2-43c2-a09d-8038921daa6a service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:12.042974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1383/2756] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:11 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:14.004063 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:14.072222 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01556680-5d71-4d5d-8785-2ba55a58ecc7 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:14.076749 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:14.077602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:14.077880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:14.078160 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] PATH_INFO: `/v3/users/fa0d026a43ba4af4923c18693f949be9` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:14.079867 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0d026a43ba4af4923c18693f949be9)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:14.081822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:14.124325 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0d026a43ba4af4923c18693f949be9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.131124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0d026a43ba4af4923c18693f949be9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.137760 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0d026a43ba4af4923c18693f949be9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.149332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0d026a43ba4af4923c18693f949be9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.149959 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0d026a43ba4af4923c18693f949be9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.155581 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1374/2757] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:14 2021] DELETE /identity/v3/users/fa0d026a43ba4af4923c18693f949be9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:14.160749 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:14.161227 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:14.161338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:14.177731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:14.179186 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:14.235472 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1384/2758] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:14.245231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:14.246685 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:14.300350 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657571eb-f69d-47a3-ace3-ed926e0c2054 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:14.303991 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:14.304614 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:14.304889 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:14.305159 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:14.314099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:14.315531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:14.324520 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1375/2759] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:14.578068 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:14.580835 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:14.593226 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e78894-911e-4342-a7ab-719ce9ac096c None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:14.597834 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:14.598715 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:14.598994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:14.599263 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] PATH_INFO: `/v3/projects/1dfdac330def4480ab17269f47290375` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:14.600497 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfdac330def4480ab17269f47290375)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:14.602419 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:14.647188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfdac330def4480ab17269f47290375', 'request_id': 'req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.653043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfdac330def4480ab17269f47290375', 'request_id': 'req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.660172 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfdac330def4480ab17269f47290375', 'request_id': 'req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.670165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] The token cache is being invalidate because project 1dfdac330def4480ab17269f47290375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:14.670447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.671066 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.672585 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1385/2760] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:14 2021] DELETE /identity/v3/projects/1dfdac330def4480ab17269f47290375 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:14.676649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:14.686605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b685e-155b-4065-9ab9-82f047d504ae service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:14.740185 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:14.741042 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:14.741341 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:14.741620 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] PATH_INFO: `/v3/users/d3ba2dcc7bf54c17845a893dbd07b855` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:14.742813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ba2dcc7bf54c17845a893dbd07b855)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:14.744759 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:14.791893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ba2dcc7bf54c17845a893dbd07b855'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.799292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ba2dcc7bf54c17845a893dbd07b855'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.805919 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ba2dcc7bf54c17845a893dbd07b855'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.818250 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ba2dcc7bf54c17845a893dbd07b855'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.818957 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ba2dcc7bf54c17845a893dbd07b855'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:14.824698 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1376/2761] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:14 2021] DELETE /identity/v3/users/d3ba2dcc7bf54c17845a893dbd07b855 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:15.080952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:15.082565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:15.097791 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055b5f-ba4e-43b8-a88a-2e13524ba2e0 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:15.153518 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:15.154398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:15.154685 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:15.154960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] PATH_INFO: `/v3/projects/c902fc8bee1a4672aa9d7b7b0cebfaf6` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:15.156145 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c902fc8bee1a4672aa9d7b7b0cebfaf6)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:15.159641 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:15.204973 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c902fc8bee1a4672aa9d7b7b0cebfaf6', 'request_id': 'req-5a6b743c-7369-429f-98a8-e9dd52468806'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.211037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c902fc8bee1a4672aa9d7b7b0cebfaf6', 'request_id': 'req-5a6b743c-7369-429f-98a8-e9dd52468806'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.218135 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c902fc8bee1a4672aa9d7b7b0cebfaf6', 'request_id': 'req-5a6b743c-7369-429f-98a8-e9dd52468806'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.228768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] The token cache is being invalidate because project c902fc8bee1a4672aa9d7b7b0cebfaf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:15.229706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.230379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.231914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1386/2762] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:15 2021] DELETE /identity/v3/projects/c902fc8bee1a4672aa9d7b7b0cebfaf6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:15.236741 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:15.238184 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:15.250679 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d88f-a244-43f1-999d-10a8064799f3 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:15.303769 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:15.304625 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:15.304903 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:15.305179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] PATH_INFO: `/v3/users/b6a1be17c9e54b9784d784462e182b6f` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:15.306577 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a1be17c9e54b9784d784462e182b6f)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:15.308551 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:15.350878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a1be17c9e54b9784d784462e182b6f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.358016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a1be17c9e54b9784d784462e182b6f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.365252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a1be17c9e54b9784d784462e182b6f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.376272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a1be17c9e54b9784d784462e182b6f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.376917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-cd52321c-5a25-48fa-95b0-a01976076ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a1be17c9e54b9784d784462e182b6f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:15.383139 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1377/2763] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:15 2021] DELETE /identity/v3/users/b6a1be17c9e54b9784d784462e182b6f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:15.889086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:15.890673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:15.904222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b743c-7369-429f-98a8-e9dd52468806 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:15.959076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:15.959930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:15.960205 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:15.960477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] PATH_INFO: `/v3/projects/46ea536d21994105be5960178b0d2a3f` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:15.961740 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ea536d21994105be5960178b0d2a3f)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:15.963661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.006478 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ea536d21994105be5960178b0d2a3f', 'request_id': 'req-314762e0-ad6d-4c2c-a835-1067bfc00809'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:16.012251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ea536d21994105be5960178b0d2a3f', 'request_id': 'req-314762e0-ad6d-4c2c-a835-1067bfc00809'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:16.019527 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ea536d21994105be5960178b0d2a3f', 'request_id': 'req-314762e0-ad6d-4c2c-a835-1067bfc00809'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:16.029261 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] The token cache is being invalidate because project 46ea536d21994105be5960178b0d2a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:16.029540 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:16.030180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-314762e0-ad6d-4c2c-a835-1067bfc00809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:16.031690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1387/2764] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:15 2021] DELETE /identity/v3/projects/46ea536d21994105be5960178b0d2a3f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:16.038409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.038697 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.038973 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.055930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:16.057106 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:16.112892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1378/2765] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 15 13:12:16.121524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.121809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.122084 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.140381 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:16.141565 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:16.149996 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1388/2766] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:16.154288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.163623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251e60e-e816-4743-b70e-17834e0c790e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.168088 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.168723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.168999 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.169269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.169992 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:12:16.170320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.171904 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.182888 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1379/2767] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:12:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:12:16.190209 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.196322 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea7ec-b99a-4740-8138-e79cd7b971d0 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.200884 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.201509 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.201783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.202055 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.202779 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.205328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.229721 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1389/2768] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:16 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:16.233803 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.243327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047e7a-0539-428f-b138-8e9245f235bd admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.298712 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.299359 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.299638 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.299907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.300589 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.302514 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.322062 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1380/2769] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:16 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:16.326125 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.336163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c2b0-182b-493c-8c98-f9f0cb703253 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.340732 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.341379 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.341661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.341937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.342711 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.344302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.355722 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1390/2770] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:16.359476 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.369750 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91d246-e78f-4bcb-82ca-f5ce074fa18f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.374288 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9668e-2d48-44dd-bec7-2fa6d85ccac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.374936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9668e-2d48-44dd-bec7-2fa6d85ccac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.375208 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9668e-2d48-44dd-bec7-2fa6d85ccac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.375474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9668e-2d48-44dd-bec7-2fa6d85ccac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.376836 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9668e-2d48-44dd-bec7-2fa6d85ccac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.378519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9668e-2d48-44dd-bec7-2fa6d85ccac1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.389395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1381/2771] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:16.393806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.403822 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644870-3483-4d27-9d9f-cfef34e6cfde admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.408494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.409355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.409631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.409899 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] PATH_INFO: `/v3/projects/13a5da6d37bc4db0b4552a72be725891/users/eb7ff18410484c45a5ab846d3139d2ab/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.424296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a5da6d37bc4db0b4552a72be725891, user_id=eb7ff18410484c45a5ab846d3139d2ab, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.426960 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.441099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1391/2772] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:16 2021] PUT /identity/v3/projects/13a5da6d37bc4db0b4552a72be725891/users/eb7ff18410484c45a5ab846d3139d2ab/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:16.452880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.453167 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.453441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.479119 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] MFA Rules not processed for user `eb7ff18410484c45a5ab846d3139d2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:16.480309 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:16.542966 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1382/2773] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:16 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:16.554988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:16.556676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:16.611169 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc78643-e452-41c3-81e6-28a00bb76430 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:16.614850 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2085c-e0a2-4092-a0f3-dd135dd3c0e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb7c470fd2684be89d1821f2abb36406', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:16.615473 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2085c-e0a2-4092-a0f3-dd135dd3c0e6 service glance] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:16.615786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2085c-e0a2-4092-a0f3-dd135dd3c0e6 service glance] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:16.616059 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2085c-e0a2-4092-a0f3-dd135dd3c0e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:16.624295 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2085c-e0a2-4092-a0f3-dd135dd3c0e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:16.625676 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2085c-e0a2-4092-a0f3-dd135dd3c0e6 service glance] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:16.635319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1392/2774] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:16 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:35.135436 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:35.201128 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503465e-b088-4dbe-95ee-b064f1e0f358 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:35.206909 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:35.207770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.208049 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.208319 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] PATH_INFO: `/v3/users/eb7ff18410484c45a5ab846d3139d2ab` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.209537 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7ff18410484c45a5ab846d3139d2ab)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:35.211462 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:35.257715 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7ff18410484c45a5ab846d3139d2ab'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.265337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7ff18410484c45a5ab846d3139d2ab'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.273193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7ff18410484c45a5ab846d3139d2ab'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.285253 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7ff18410484c45a5ab846d3139d2ab'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.285945 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7ff18410484c45a5ab846d3139d2ab'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.291651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1383/2775] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:35 2021] DELETE /identity/v3/users/eb7ff18410484c45a5ab846d3139d2ab => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:35.296251 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.296734 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.296833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.314658 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:35.316369 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:35.371564 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1393/2776] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:35.382114 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:35.383547 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:35.440711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f246a0-f6c3-41e4-ab89-023f453a9d43 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:35.444604 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d282af-60dc-4d2b-a421-ad26eca252b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:35.445272 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d282af-60dc-4d2b-a421-ad26eca252b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.445559 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d282af-60dc-4d2b-a421-ad26eca252b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.445848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d282af-60dc-4d2b-a421-ad26eca252b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.455308 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d282af-60dc-4d2b-a421-ad26eca252b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:35.457356 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d282af-60dc-4d2b-a421-ad26eca252b7 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:35.466784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1384/2777] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:35.717965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:35.719411 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:35.730902 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042670bc-1b71-4da7-addb-9c51bdf14b24 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:35.735764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:35.736626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.737516 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.737796 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] PATH_INFO: `/v3/projects/13a5da6d37bc4db0b4552a72be725891` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.739050 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a5da6d37bc4db0b4552a72be725891)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:35.741057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:35.788763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a5da6d37bc4db0b4552a72be725891', 'request_id': 'req-42102e3d-8360-475b-b258-bd0285b4b8cb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.794593 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a5da6d37bc4db0b4552a72be725891', 'request_id': 'req-42102e3d-8360-475b-b258-bd0285b4b8cb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.803026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a5da6d37bc4db0b4552a72be725891', 'request_id': 'req-42102e3d-8360-475b-b258-bd0285b4b8cb'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.815629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] The token cache is being invalidate because project 13a5da6d37bc4db0b4552a72be725891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:35.815987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.816793 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-42102e3d-8360-475b-b258-bd0285b4b8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:35.818589 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1394/2778] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:35 2021] DELETE /identity/v3/projects/13a5da6d37bc4db0b4552a72be725891 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:35.825077 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.825454 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.825829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.843768 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:35.845026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:35.903724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1385/2779] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:35.912318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.912606 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.912885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.931198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:35.932377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:35.940677 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1395/2780] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:35.945212 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:35.955328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f87552-75d1-48f5-a577-7c6025028d46 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:35.960144 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:35.960809 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.961126 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.961416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] PATH_INFO: `/v3/domains` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.962215 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79109) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:12:35.962543 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:35.964200 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:35.975875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1386/2781] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:12:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:12:35.980095 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:35.989561 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249479d-a2a4-49b3-a05e-f74e22549710 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:35.994468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:35.995122 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:35.995404 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:35.995673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:35.996402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:35.998345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.023230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1396/2782] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:35 2021] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:36.027412 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.037676 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f77a2-59f1-4d71-9a7d-4261c51dd94e admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.091258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.091921 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.092199 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.092497 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.093179 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.095141 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.115216 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1387/2783] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:36.119367 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.129386 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fc0d-c184-45f4-bbf0-4ce5e07cd9be admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.134306 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.134955 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.135235 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.135508 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.136273 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.137857 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.148164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1397/2784] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:36.151852 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.162075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975a4d-30f5-4027-8d33-755c46df0fe7 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.166506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00f48-fbd4-4778-918b-1751fe1e8249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.167137 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00f48-fbd4-4778-918b-1751fe1e8249 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.167411 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00f48-fbd4-4778-918b-1751fe1e8249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.167678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00f48-fbd4-4778-918b-1751fe1e8249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.168401 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f00f48-fbd4-4778-918b-1751fe1e8249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.169971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f00f48-fbd4-4778-918b-1751fe1e8249 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.180007 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1388/2785] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:36.183887 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.193352 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca84d1f-fb9a-42ee-aae2-5249c5dd6b27 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.197915 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.198802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.199080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.199353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] PATH_INFO: `/v3/projects/0b5ffd54c60a48fca447e1c38085e3dd/users/65410e9e49f74c6bbade2f343c4119c1/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.213180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5ffd54c60a48fca447e1c38085e3dd, user_id=65410e9e49f74c6bbade2f343c4119c1, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.215846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.229344 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1398/2786] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:36 2021] PUT /identity/v3/projects/0b5ffd54c60a48fca447e1c38085e3dd/users/65410e9e49f74c6bbade2f343c4119c1/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:36.239980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.240258 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.240531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.267332 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] MFA Rules not processed for user `65410e9e49f74c6bbade2f343c4119c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:36.268521 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:36.328143 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1389/2787] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:36.332640 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.391035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a697-01f9-4c29-b87f-08b9ec73901a admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.395690 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.396332 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.396609 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.396880 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.397568 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.399481 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.423578 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1399/2788] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:36.428298 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.438727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe433a6-6a60-4c76-8b5d-69ba839e897d None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.492900 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.493560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.493858 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.494131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.494844 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.496789 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.515560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1390/2789] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:36.520102 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.530033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b4cf-4a8e-473f-a614-ce28ba305dae admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.535164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.535810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.536090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.536364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.537093 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.538700 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.548861 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1400/2790] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:36.552696 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.562434 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f09a8a-1e8e-444d-a4d1-8507c7b97898 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.567157 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541bf46-489a-4b7c-ac2f-536659962973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.567816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541bf46-489a-4b7c-ac2f-536659962973 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.568097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541bf46-489a-4b7c-ac2f-536659962973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.568373 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541bf46-489a-4b7c-ac2f-536659962973 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.569107 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541bf46-489a-4b7c-ac2f-536659962973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.570724 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541bf46-489a-4b7c-ac2f-536659962973 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.580416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1391/2791] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:36.585077 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.594730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e365557-98e4-45ac-9be1-a9013ecfd35e admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.599914 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.600778 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] REQUEST_METHOD: `PUT` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.601076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.601329 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] PATH_INFO: `/v3/projects/741d1a55f9fd4d429d573690949d4042/users/fc28249d780c4a4596cc2b0379eb47c4/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.615239 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741d1a55f9fd4d429d573690949d4042, user_id=fc28249d780c4a4596cc2b0379eb47c4, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.617942 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.630602 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1401/2792] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:36 2021] PUT /identity/v3/projects/741d1a55f9fd4d429d573690949d4042/users/fc28249d780c4a4596cc2b0379eb47c4/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:36.641465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.641868 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.642165 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.668731 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] MFA Rules not processed for user `fc28249d780c4a4596cc2b0379eb47c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:36.669929 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:36.731400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1392/2793] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:36.735811 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.793603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc316-e1c8-43b1-8f74-1cc4eb031850 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.798228 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.798875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.799155 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.799428 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] PATH_INFO: `/v3/projects` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.800131 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.802011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.827090 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1402/2794] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:36.831723 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.842064 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668fa6c-043b-4cbe-8a8e-ce7521e7d34a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.894907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.895568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.895849 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.896138 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.896831 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.898774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.918025 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1393/2795] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:36 2021] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 15 13:12:36.922039 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.931948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1b387-881e-4541-90f1-2b9dbcf49029 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.936809 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.937488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.937769 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.938041 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.938812 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.940886 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:36.952276 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1403/2796] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:36.956851 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:36.966371 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169f61-0b99-4f94-b5ed-669f354c01a8 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:36.971811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:36.972745 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:36.973293 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:36.973597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] PATH_INFO: `/v3/projects/decd42f5a08547e987ddb01ee5e1df76/users/78f57eaae36244c6b54974f4f0bb5dca/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:36.987725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=decd42f5a08547e987ddb01ee5e1df76, user_id=78f57eaae36244c6b54974f4f0bb5dca, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:36.990328 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:37.005154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1394/2797] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:36 2021] PUT /identity/v3/projects/decd42f5a08547e987ddb01ee5e1df76/users/78f57eaae36244c6b54974f4f0bb5dca/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:37.009011 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:37.019937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc9c99-ae4e-409e-988b-77f1e609ad07 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:37.072320 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084952-9db7-400e-875a-b66e398c5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:37.072977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084952-9db7-400e-875a-b66e398c5b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:37.073257 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084952-9db7-400e-875a-b66e398c5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:37.073529 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084952-9db7-400e-875a-b66e398c5b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:37.074288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19084952-9db7-400e-875a-b66e398c5b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:37.075873 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19084952-9db7-400e-875a-b66e398c5b2b admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:37.086026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1404/2798] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:37 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:37.090291 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:37.100264 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1ea2f-759e-4c2a-91d6-b0b406f33a8f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:37.104825 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:37.105684 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:37.106002 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:37.106289 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] PATH_INFO: `/v3/projects/decd42f5a08547e987ddb01ee5e1df76/users/78f57eaae36244c6b54974f4f0bb5dca/roles/a78d70a0713545a6a42a87be894a6d14` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:37.108240 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=decd42f5a08547e987ddb01ee5e1df76, user_id=78f57eaae36244c6b54974f4f0bb5dca, role_id=a78d70a0713545a6a42a87be894a6d14)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:37.110892 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:37.120823 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1395/2799] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:37 2021] PUT /identity/v3/projects/decd42f5a08547e987ddb01ee5e1df76/users/78f57eaae36244c6b54974f4f0bb5dca/roles/a78d70a0713545a6a42a87be894a6d14 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:37.131714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:37.132003 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:37.132277 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:37.157977 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] MFA Rules not processed for user `78f57eaae36244c6b54974f4f0bb5dca`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:37.159289 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:37.222961 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1405/2800] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:37 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:37.233331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:37.235018 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:37.289271 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38076-788c-46ca-95f6-72d11fd1cf4a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:37.292788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:37.293409 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:37.293687 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:37.293955 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:37.346732 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:37.348155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:37.356936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1396/2801] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:38.958815 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:38.960220 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:38.972402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade17233-9b5e-4e83-ad91-ab80f02bc7e4 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:38.976000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:38.976629 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:38.976910 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:38.977185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:39.030775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:39.032262 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:39.043548 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1406/2802] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:38 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:39.521612 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:39.532917 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1d0f0-40c1-4ccc-98b8-d0c78151e93e service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:39.538044 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9120d-d378-4f49-b847-2a5d81335bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:39.538720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9120d-d378-4f49-b847-2a5d81335bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:39.539004 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9120d-d378-4f49-b847-2a5d81335bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:39.539283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9120d-d378-4f49-b847-2a5d81335bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:39.548970 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9120d-d378-4f49-b847-2a5d81335bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:39.550961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9120d-d378-4f49-b847-2a5d81335bf2 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:39.560580 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1397/2803] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:39 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:43.343918 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:43.402738 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa05878-429b-490c-8ab7-e29da9666448 service cinder] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:43.407222 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:43.408069 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:43.408349 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:43.408621 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] PATH_INFO: `/v3/users/65410e9e49f74c6bbade2f343c4119c1` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:43.409810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=65410e9e49f74c6bbade2f343c4119c1)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:43.411753 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:43.455317 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65410e9e49f74c6bbade2f343c4119c1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:43.462043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65410e9e49f74c6bbade2f343c4119c1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:43.468474 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65410e9e49f74c6bbade2f343c4119c1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:43.469097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65410e9e49f74c6bbade2f343c4119c1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:43.480979 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65410e9e49f74c6bbade2f343c4119c1'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:43.486710 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1407/2804] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:43 2021] DELETE /identity/v3/users/65410e9e49f74c6bbade2f343c4119c1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:43.491177 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:43.491661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:43.491778 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:43.508860 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:43.510082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:43.566531 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1398/2805] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:43.576488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:43.577867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:43.634073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3836a-2d7e-4501-9330-65fae22900ac admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:43.637763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:43.638485 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:43.638717 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:43.638992 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:43.648374 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:43.649802 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:43.658946 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1408/2806] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:43.923230 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:43.925152 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:43.937761 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb2233-edde-4281-8ae5-58ae00fe1be6 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:43.942961 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:43.943918 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:43.944311 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:43.944446 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] PATH_INFO: `/v3/projects/0b5ffd54c60a48fca447e1c38085e3dd` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:43.945683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5ffd54c60a48fca447e1c38085e3dd)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:43.947656 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:43.992541 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5ffd54c60a48fca447e1c38085e3dd', 'request_id': 'req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:43.998486 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5ffd54c60a48fca447e1c38085e3dd', 'request_id': 'req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.006718 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5ffd54c60a48fca447e1c38085e3dd', 'request_id': 'req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.017161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] The token cache is being invalidate because project 0b5ffd54c60a48fca447e1c38085e3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:44.017519 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.018354 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.020082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1399/2807] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:43 2021] DELETE /identity/v3/projects/0b5ffd54c60a48fca447e1c38085e3dd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:44.024391 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:44.033863 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8b4c9-42c8-410f-9951-64810c6b9bca service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:44.090294 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:44.091165 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:44.091443 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:44.091714 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] PATH_INFO: `/v3/users/fc28249d780c4a4596cc2b0379eb47c4` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:44.092949 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc28249d780c4a4596cc2b0379eb47c4)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:44.094908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:44.142480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc28249d780c4a4596cc2b0379eb47c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.150742 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc28249d780c4a4596cc2b0379eb47c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.158599 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc28249d780c4a4596cc2b0379eb47c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.159596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc28249d780c4a4596cc2b0379eb47c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.171988 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc28249d780c4a4596cc2b0379eb47c4'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.178706 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1409/2808] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:44 2021] DELETE /identity/v3/users/fc28249d780c4a4596cc2b0379eb47c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:44.432155 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:44.433597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:44.446869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee800-72fb-40a2-89ac-7fc9f4d8fb1f admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:44.508015 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:44.508930 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:44.509231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:44.509522 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] PATH_INFO: `/v3/projects/741d1a55f9fd4d429d573690949d4042` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:44.510845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=741d1a55f9fd4d429d573690949d4042)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:44.512869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:44.562030 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741d1a55f9fd4d429d573690949d4042', 'request_id': 'req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.568668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741d1a55f9fd4d429d573690949d4042', 'request_id': 'req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.576151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741d1a55f9fd4d429d573690949d4042', 'request_id': 'req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.586599 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] The token cache is being invalidate because project 741d1a55f9fd4d429d573690949d4042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:44.586884 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.587540 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.589099 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1400/2809] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:44 2021] DELETE /identity/v3/projects/741d1a55f9fd4d429d573690949d4042 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:44.593048 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:44.594491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:44.607502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa6c67-f8ce-4a4b-8938-013e6f7118e8 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:44.660976 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:44.661836 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:44.662110 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:44.662406 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] PATH_INFO: `/v3/users/78f57eaae36244c6b54974f4f0bb5dca` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:44.663603 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f57eaae36244c6b54974f4f0bb5dca)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:44.665517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:44.709111 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f57eaae36244c6b54974f4f0bb5dca'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.715480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f57eaae36244c6b54974f4f0bb5dca'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.723115 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f57eaae36244c6b54974f4f0bb5dca'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.723767 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f57eaae36244c6b54974f4f0bb5dca'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.735046 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-a979d35e-0ad5-4158-af42-74cfe845c433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f57eaae36244c6b54974f4f0bb5dca'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:44.741310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1410/2810] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:44 2021] DELETE /identity/v3/users/78f57eaae36244c6b54974f4f0bb5dca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:45.017075 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.018627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:45.031568 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4064-a7b3-42cb-a4e6-1ade86a85e62 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.092074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.092916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.093193 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.093465 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] PATH_INFO: `/v3/projects/decd42f5a08547e987ddb01ee5e1df76` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.094668 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=decd42f5a08547e987ddb01ee5e1df76)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.097074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.140076 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decd42f5a08547e987ddb01ee5e1df76', 'request_id': 'req-a484e0ba-e234-4551-8171-9daa394084fc'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:45.145810 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decd42f5a08547e987ddb01ee5e1df76', 'request_id': 'req-a484e0ba-e234-4551-8171-9daa394084fc'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:45.152586 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decd42f5a08547e987ddb01ee5e1df76', 'request_id': 'req-a484e0ba-e234-4551-8171-9daa394084fc'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:45.162722 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] The token cache is being invalidate because project decd42f5a08547e987ddb01ee5e1df76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:45.163032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:45.163651 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-a484e0ba-e234-4551-8171-9daa394084fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:45.165161 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1401/2811] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:45 2021] DELETE /identity/v3/projects/decd42f5a08547e987ddb01ee5e1df76 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:45.171346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.171628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.171901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.192455 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:45.193786 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:45.253440 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1411/2812] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:45.261678 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.261965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.262315 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.280453 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:45.281672 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:45.290385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1402/2813] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:45.295073 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.305608 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76356-e64d-4f5e-9bab-82b38630bf26 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.310778 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.311449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.311726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.311993 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.312727 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:12:45.313026 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.314775 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.329465 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1412/2814] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:12:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:12:45.330848 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.339866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7668-4a86-4822-8952-b16cfb5e2bec None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.344784 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.345498 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.345842 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.346725 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.347423 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.349297 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.374502 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1403/2815] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:45 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:45.378601 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.388431 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df8657-5e64-4715-90ac-ee4fd61270ac admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.441018 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.441667 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.441944 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.442269 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.442963 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.444916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.463806 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1413/2816] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:45 2021] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:45.468158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.478653 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567533e-3e98-4cba-8c38-2cec1e7605b0 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.483188 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.483824 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.484103 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.484372 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.485090 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.486716 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.496623 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1404/2817] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:12:45.500364 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.510212 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd718bf-d915-4377-a52e-197bb0c92e70 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.514771 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae7d9-45ea-4e7d-b1b2-512496f9b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.515407 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae7d9-45ea-4e7d-b1b2-512496f9b69f admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.515691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae7d9-45ea-4e7d-b1b2-512496f9b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.515952 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae7d9-45ea-4e7d-b1b2-512496f9b69f admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.516683 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae7d9-45ea-4e7d-b1b2-512496f9b69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.518819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae7d9-45ea-4e7d-b1b2-512496f9b69f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.528477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1414/2818] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:45.532644 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.542980 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb924cc-e364-4e6d-bfcf-539a584fb406 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.547594 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.548452 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.548740 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.549016 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] PATH_INFO: `/v3/projects/572291c7dafe47c98852d1200c054440/users/574a85ca2db3478a84a418912401f70c/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.563168 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572291c7dafe47c98852d1200c054440, user_id=574a85ca2db3478a84a418912401f70c, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.565834 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.578263 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1405/2819] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:45 2021] PUT /identity/v3/projects/572291c7dafe47c98852d1200c054440/users/574a85ca2db3478a84a418912401f70c/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:45.589164 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.589488 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.589743 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.616076 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] MFA Rules not processed for user `574a85ca2db3478a84a418912401f70c`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:45.617302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:45.678008 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1415/2820] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:45 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:45.688561 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:45.690283 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:45.745083 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfbe24-6a50-4281-8350-5c058ca312c9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:45.748662 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468d780-51eb-4bd8-8ee4-941fda9a9deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:45.749301 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d780-51eb-4bd8-8ee4-941fda9a9deb service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:45.749583 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d780-51eb-4bd8-8ee4-941fda9a9deb service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:45.749855 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468d780-51eb-4bd8-8ee4-941fda9a9deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:45.758408 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468d780-51eb-4bd8-8ee4-941fda9a9deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:45.759829 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468d780-51eb-4bd8-8ee4-941fda9a9deb service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:45.768938 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1406/2821] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:45 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:48.267865 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:48.327783 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e194f-689f-450c-8d54-1955c0ce1f1b None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:48.332292 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:48.333144 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:48.333418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:48.333688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] PATH_INFO: `/v3/users/574a85ca2db3478a84a418912401f70c` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:48.334904 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574a85ca2db3478a84a418912401f70c)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:48.336798 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:48.381505 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574a85ca2db3478a84a418912401f70c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:48.392203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574a85ca2db3478a84a418912401f70c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:48.400579 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574a85ca2db3478a84a418912401f70c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:48.401337 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574a85ca2db3478a84a418912401f70c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:48.413891 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574a85ca2db3478a84a418912401f70c'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:48.419990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1416/2822] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:48 2021] DELETE /identity/v3/users/574a85ca2db3478a84a418912401f70c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:48.425652 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:48.426198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:48.426198 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:48.442779 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:48.443965 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:48.498898 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1407/2823] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:48.509449 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:48.510912 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:48.567270 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547e21-1731-421e-b247-55a99c0f31c7 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:48.570892 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f6c09-24da-4c78-9026-bb46f4a0d68c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:48.571524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f6c09-24da-4c78-9026-bb46f4a0d68c service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:48.571823 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f6c09-24da-4c78-9026-bb46f4a0d68c service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:48.572096 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f6c09-24da-4c78-9026-bb46f4a0d68c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:48.581185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f6c09-24da-4c78-9026-bb46f4a0d68c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:48.582628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f6c09-24da-4c78-9026-bb46f4a0d68c service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:48.591673 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1417/2824] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:48.943751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:48.945202 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:48.957796 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628bde8-c72d-4503-afb7-d8223e5b752a None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:48.962475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:48.963337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:48.963633 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:48.963927 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] PATH_INFO: `/v3/projects/572291c7dafe47c98852d1200c054440` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:48.965683 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572291c7dafe47c98852d1200c054440)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:48.967091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.012398 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572291c7dafe47c98852d1200c054440', 'request_id': 'req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:49.018886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572291c7dafe47c98852d1200c054440', 'request_id': 'req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:49.025982 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572291c7dafe47c98852d1200c054440', 'request_id': 'req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:49.037474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] The token cache is being invalidate because project 572291c7dafe47c98852d1200c054440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:12:49.037474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:49.037474 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-be99bc8e-cf5b-4ff9-a0de-60fc2afc03c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:49.038324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1408/2825] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:12:48 2021] DELETE /identity/v3/projects/572291c7dafe47c98852d1200c054440 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:49.044825 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.045138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.045418 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.063388 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:49.065223 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:49.125138 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1418/2826] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:49.133739 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.134074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.134382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.153573 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:49.154806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:49.162757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1409/2827] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:49.167092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.177365 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4e405-9989-42ff-a879-72b2afca6603 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.181932 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.182615 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.182900 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.183173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.183916 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:12:49.184221 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.185828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.198716 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1419/2828] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:12:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:12:49.202881 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.212382 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b7c7c-928b-413d-82d6-1946707d7397 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.217131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.217791 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.218070 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.218365 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.219074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.221097 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.250182 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1410/2829] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:12:49 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:49.255057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.265774 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc806322-a1fa-42e7-89d1-17802c2599d2 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.321203 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.321907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.322035 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.322323 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.323062 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.325002 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.346572 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1420/2830] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:12:49 2021] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:12:49.350813 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.362352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d001705-5638-4905-aa7b-88520169b188 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.366950 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.367615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.367933 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.368206 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.368936 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.370558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.381820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1411/2831] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 15 13:12:49.386412 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.396494 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bf4c0-49a5-4c37-9f33-57572b5c72de admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.401104 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fccbe-cbcc-4a63-bfb7-f44b933c1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.401754 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fccbe-cbcc-4a63-bfb7-f44b933c1b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.402037 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fccbe-cbcc-4a63-bfb7-f44b933c1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.402546 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fccbe-cbcc-4a63-bfb7-f44b933c1b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.403286 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fccbe-cbcc-4a63-bfb7-f44b933c1b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.404896 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fccbe-cbcc-4a63-bfb7-f44b933c1b55 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.415331 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1421/2832] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:12:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:12:49.419667 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.429958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b68d0-ef5e-4629-992b-931a911ca0cb admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.435031 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.435911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.438337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.438337 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] PATH_INFO: `/v3/projects/d3aa23d2f5224ca3a893bdd340ad670e/users/dec552405ba54d92aad87fdfedc7c6df/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.451951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3aa23d2f5224ca3a893bdd340ad670e, user_id=dec552405ba54d92aad87fdfedc7c6df, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.454640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.469727 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1412/2833] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:12:49 2021] PUT /identity/v3/projects/d3aa23d2f5224ca3a893bdd340ad670e/users/dec552405ba54d92aad87fdfedc7c6df/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:12:49.480763 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.481047 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.481324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.508296 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] MFA Rules not processed for user `dec552405ba54d92aad87fdfedc7c6df`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:49.509498 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:49.573072 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1422/2834] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:49 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:49.582756 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:49.584524 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:49.640121 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c25b9-a558-4137-b620-1f62074d6c43 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:49.643720 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:49.644353 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:49.644636 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:49.644907 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:49.652943 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:49.654394 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:49.663647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1413/2835] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:49 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:55.323272 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:55.324719 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:55.402043 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a22b-9ad3-4737-b98a-fc6c8d36c663 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:55.406994 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:55.407707 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:55.407987 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:55.408430 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:55.410340 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:55.421947 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:55.424181 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:55.434842 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1423/2836] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:56.149979 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:56.151582 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:56.216032 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14a716-e415-456a-b525-2e380cd55662 service cinder] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:56.222320 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:56.223391 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:56.223932 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:56.224329 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:56.227238 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:56.240912 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:56.243911 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0a82c-5e2f-4402-b26c-9a0c0814a8b6 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:56.260124 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1414/2837] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:12:59.352940 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:59.412903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38104b-ebaa-4d68-97bd-b1f3e845f24e service placement] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:59.417626 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:59.418524 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:59.418810 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:59.419107 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] PATH_INFO: `/v3/users/dec552405ba54d92aad87fdfedc7c6df` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:59.420291 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec552405ba54d92aad87fdfedc7c6df)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:59.422279 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:59.478284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec552405ba54d92aad87fdfedc7c6df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:59.485649 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec552405ba54d92aad87fdfedc7c6df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:59.492475 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec552405ba54d92aad87fdfedc7c6df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:59.493163 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec552405ba54d92aad87fdfedc7c6df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:59.505408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec552405ba54d92aad87fdfedc7c6df'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:12:59.511230 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1424/2838] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:12:59 2021] DELETE /identity/v3/users/dec552405ba54d92aad87fdfedc7c6df => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:12:59.516378 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:59.516886 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:59.517622 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:59.536816 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:12:59.538349 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:59.596400 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1415/2839] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:12:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:12:59.606845 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:12:59.608310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:12:59.674785 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b6575-1941-4adf-bf4c-af0efbe06389 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:12:59.678447 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6337c05-dfd2-4df2-a65c-23aa8332ed68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:12:59.679086 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337c05-dfd2-4df2-a65c-23aa8332ed68 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:12:59.679365 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337c05-dfd2-4df2-a65c-23aa8332ed68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:12:59.679638 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6337c05-dfd2-4df2-a65c-23aa8332ed68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:12:59.689451 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337c05-dfd2-4df2-a65c-23aa8332ed68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:12:59.690913 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6337c05-dfd2-4df2-a65c-23aa8332ed68 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:12:59.700965 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1425/2840] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:12:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:13:00.055874 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.057388 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:00.070647 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa975-1b2c-4221-9dca-13a2d73c303f None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.076127 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.076978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.077292 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.077517 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] PATH_INFO: `/v3/projects/d3aa23d2f5224ca3a893bdd340ad670e` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.078734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3aa23d2f5224ca3a893bdd340ad670e)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.080807 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.130661 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3aa23d2f5224ca3a893bdd340ad670e', 'request_id': 'req-fa9aad8e-4e47-493c-974d-63e5c78c278b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:00.136627 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3aa23d2f5224ca3a893bdd340ad670e', 'request_id': 'req-fa9aad8e-4e47-493c-974d-63e5c78c278b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:00.143728 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3aa23d2f5224ca3a893bdd340ad670e', 'request_id': 'req-fa9aad8e-4e47-493c-974d-63e5c78c278b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:00.154102 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] The token cache is being invalidate because project d3aa23d2f5224ca3a893bdd340ad670e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:13:00.154413 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:00.155038 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-fa9aad8e-4e47-493c-974d-63e5c78c278b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:00.156630 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1416/2841] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:13:00 2021] DELETE /identity/v3/projects/d3aa23d2f5224ca3a893bdd340ad670e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:13:00.162807 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.163097 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.163375 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.181118 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:13:00.182366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:00.238746 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1426/2842] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:13:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:13:00.246806 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.247110 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.247390 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.265675 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:13:00.266916 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:00.274914 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1417/2843] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:13:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:13:00.279188 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.289991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c91a-c99d-44a2-bdf2-e2deaa5eb3e9 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.294922 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.295635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.295958 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.296233 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.297049 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 15 13:13:00.297353 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.299669 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.311490 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1427/2844] 10.222.0.57 () {58 vars in 1152 bytes} [Wed Dec 15 13:13:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 15 13:13:00.315910 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.325506 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f55e9a-1d93-494c-8e43-6099ccdf48df None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.331357 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.332131 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.332410 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.332680 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.333395 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.335351 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.364781 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1418/2845] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Dec 15 13:13:00 2021] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:13:00.368128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.378028 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513d57-0024-4939-804a-8e751f5f7ea5 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.432633 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.433288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.433566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.433833 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] PATH_INFO: `/v3/users` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.434569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.436468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.456345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1428/2846] 10.222.0.57 () {60 vars in 1143 bytes} [Wed Dec 15 13:13:00 2021] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 15 13:13:00.460433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.471691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7a1cd-d0f9-4e57-826c-7e4bb900fb7a admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.476441 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.477092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.477375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.477648 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.478415 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.480003 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.490158 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1419/2847] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:13:00.493990 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.504150 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b16cea-ca56-41fe-8f31-5b8ccabb34af admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.508768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773093b3-1af2-4f3d-9e13-5e44877ab5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.509427 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773093b3-1af2-4f3d-9e13-5e44877ab5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.509692 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773093b3-1af2-4f3d-9e13-5e44877ab5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.509964 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773093b3-1af2-4f3d-9e13-5e44877ab5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.510728 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773093b3-1af2-4f3d-9e13-5e44877ab5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.512302 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773093b3-1af2-4f3d-9e13-5e44877ab5d9 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.522441 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1429/2848] 10.222.0.57 () {58 vars in 1121 bytes} [Wed Dec 15 13:13:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 15 13:13:00.526692 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.537151 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8decab-895e-454a-b85b-92d11f9bb9f1 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.541775 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.542971 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.543352 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.543632 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] PATH_INFO: `/v3/projects/4fc0ca1b861c48338ae764565ddc5564/users/58665f527cfb4092bc8812b708ac9fce/roles/864e7e8eaded488ba7be82618e54cf49` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.557751 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc0ca1b861c48338ae764565ddc5564, user_id=58665f527cfb4092bc8812b708ac9fce, role_id=864e7e8eaded488ba7be82618e54cf49)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.560428 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.573235 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1420/2849] 10.222.0.57 () {60 vars in 1482 bytes} [Wed Dec 15 13:13:00 2021] PUT /identity/v3/projects/4fc0ca1b861c48338ae764565ddc5564/users/58665f527cfb4092bc8812b708ac9fce/roles/864e7e8eaded488ba7be82618e54cf49 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:13:00.585225 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.585515 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.585821 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.612298 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] MFA Rules not processed for user `58665f527cfb4092bc8812b708ac9fce`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:13:00.613507 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:00.675377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1430/2850] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:13:00 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:13:00.686176 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:00.688080 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:00.742555 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295b125-bbc5-45f0-9d4d-57ce9efd45ca admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:00.746244 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c364cd5-a709-443f-b8f3-55fee9f0dbf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77e852bb87284a4c9bd820d088bcb759', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:00.746875 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c364cd5-a709-443f-b8f3-55fee9f0dbf3 service cinder] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:00.747153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c364cd5-a709-443f-b8f3-55fee9f0dbf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:00.747425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c364cd5-a709-443f-b8f3-55fee9f0dbf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:00.755822 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c364cd5-a709-443f-b8f3-55fee9f0dbf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:00.757241 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c364cd5-a709-443f-b8f3-55fee9f0dbf3 service cinder] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:00.765755 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1421/2851] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:13:00 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:13:08.836750 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:08.906576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a397f-b661-48d7-bfe7-45947ff24bd6 None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:08.912756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:08.913631 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:08.914330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:08.914330 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] PATH_INFO: `/v3/users/58665f527cfb4092bc8812b708ac9fce` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:08.915503 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58665f527cfb4092bc8812b708ac9fce)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:08.917491 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:08.965157 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58665f527cfb4092bc8812b708ac9fce'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:08.973618 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58665f527cfb4092bc8812b708ac9fce'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:08.980512 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58665f527cfb4092bc8812b708ac9fce'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:08.981156 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58665f527cfb4092bc8812b708ac9fce'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:08.992569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58665f527cfb4092bc8812b708ac9fce'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:08.998661 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1431/2852] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:13:08 2021] DELETE /identity/v3/users/58665f527cfb4092bc8812b708ac9fce => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:13:09.003331 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:09.004154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:09.004154 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:09.021772 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] MFA Rules not processed for user `3ad517a276964868864b69d91a8b9aea`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:13:09.023022 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:09.083788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1422/2853] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:13:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:13:09.094038 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:09.096124 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:09.158931 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b282f-f2b3-4843-9c1d-7059446eb760 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:09.162654 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2497-a0b1-4bbf-8b86-161a1aa201fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:09.163318 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2497-a0b1-4bbf-8b86-161a1aa201fa service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:09.163600 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2497-a0b1-4bbf-8b86-161a1aa201fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:09.163870 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2497-a0b1-4bbf-8b86-161a1aa201fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:09.173080 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2497-a0b1-4bbf-8b86-161a1aa201fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:09.174628 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2497-a0b1-4bbf-8b86-161a1aa201fa service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:09.184182 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1432/2854] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:13:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:13:09.461758 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:09.463713 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:09.478039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fbcf0-87a4-463d-a8d5-45e4c649fa61 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:09.482987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:09.484558 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:09.485523 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:09.485826 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] PATH_INFO: `/v3/projects/4fc0ca1b861c48338ae764565ddc5564` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:09.487142 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc0ca1b861c48338ae764565ddc5564)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:09.489082 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:09.539602 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc0ca1b861c48338ae764565ddc5564', 'request_id': 'req-974f075d-371d-4725-bd6e-8bbb53111cc5'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:09.548019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc0ca1b861c48338ae764565ddc5564', 'request_id': 'req-974f075d-371d-4725-bd6e-8bbb53111cc5'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:09.556072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc0ca1b861c48338ae764565ddc5564', 'request_id': 'req-974f075d-371d-4725-bd6e-8bbb53111cc5'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:09.567163 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] The token cache is being invalidate because project 4fc0ca1b861c48338ae764565ddc5564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:13:09.567448 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:09.568091 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:13:09.569869 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1423/2855] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:13:09 2021] DELETE /identity/v3/projects/4fc0ca1b861c48338ae764565ddc5564 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 15 13:13:51.349733 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:51.350402 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:51.350517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:51.370730 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] MFA Rules not processed for user `913f4595b6444821801332dacab3c616`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:13:51.372246 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:51.431688 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1433/2856] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:13:51 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:13:56.833433 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:56.835027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:56.892333 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f075d-371d-4725-bd6e-8bbb53111cc5 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:56.895951 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:56.896597 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:56.896878 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:56.897153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:56.898954 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:56.968880 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:56.970407 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:56.982058 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1424/2857] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:13:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:13:58.153319 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:13:58.154867 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:58.167338 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba1493-736e-463b-9d36-523a2d55160f None None] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:13:58.170908 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:13:58.171566 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:13:58.171851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:13:58.172128 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:13:58.173875 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:13:58.187033 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:13:58.188956 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:13:58.200240 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1434/2858] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:13:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:14:22.057744 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:14:22.059243 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:14:22.072798 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50583a4-218c-4d62-8f17-f2384304c13c service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:14:22.080074 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:14:22.080737 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:14:22.081019 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:14:22.081294 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:14:22.083153 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:14:22.096952 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:14:22.098615 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:14:22.110430 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1425/2859] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:14:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:14:22.188726 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:14:22.206625 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e833-98a6-4bba-b97c-6917896a7afe service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:14:22.213244 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:14:22.214288 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:14:22.214780 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:14:22.215239 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:14:22.218876 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:14:22.236015 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:14:22.238635 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:14:22.253468 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1435/2860] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:14:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:14:32.318774 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:14:32.320437 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:14:32.391017 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333b9e-d441-46f7-9658-01afc885bb1e service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:14:32.395866 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:14:32.396757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:14:32.397037 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:14:32.397310 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] PATH_INFO: `/v3/users/c53181e8b308404185e2c38749ee619b` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:14:32.398592 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53181e8b308404185e2c38749ee619b)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:14:32.401040 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:14:32.449640 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53181e8b308404185e2c38749ee619b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.456895 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53181e8b308404185e2c38749ee619b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.463711 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53181e8b308404185e2c38749ee619b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.475146 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53181e8b308404185e2c38749ee619b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.475887 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53181e8b308404185e2c38749ee619b'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.481987 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1426/2861] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:14:32 2021] DELETE /identity/v3/users/c53181e8b308404185e2c38749ee619b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:14:32.655390 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:14:32.667937 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb878f0e-7e9c-422e-9043-63d1791e3ae6 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:14:32.729643 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:14:32.730569 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:14:32.730854 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:14:32.731129 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] PATH_INFO: `/v3/projects/8d6505d138c547538566bf960f213d4a` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:14:32.733120 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6505d138c547538566bf960f213d4a)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:14:32.735686 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:14:32.782948 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6505d138c547538566bf960f213d4a', 'request_id': 'req-4851070f-1721-4f05-bd48-87b3fb753a64'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.788907 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6505d138c547538566bf960f213d4a', 'request_id': 'req-4851070f-1721-4f05-bd48-87b3fb753a64'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.796513 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6505d138c547538566bf960f213d4a', 'request_id': 'req-4851070f-1721-4f05-bd48-87b3fb753a64'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.807583 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] The token cache is being invalidate because project 8d6505d138c547538566bf960f213d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:14:32.807930 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.808517 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.813328 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1436/2862] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:14:32 2021] DELETE /identity/v3/projects/8d6505d138c547538566bf960f213d4a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:14:32.814385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:14:32.815814 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:14:32.828946 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240bd6a-e4d1-4af4-9e21-1e92aef87a83 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:14:32.886269 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:14:32.887148 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:14:32.887417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:14:32.887690 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] PATH_INFO: `/v3/users/d19c9032b3e04003a81c0da1cec2a4ea` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:14:32.888958 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19c9032b3e04003a81c0da1cec2a4ea)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:14:32.891818 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:14:32.946417 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19c9032b3e04003a81c0da1cec2a4ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.954475 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19c9032b3e04003a81c0da1cec2a4ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.967702 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19c9032b3e04003a81c0da1cec2a4ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.980377 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19c9032b3e04003a81c0da1cec2a4ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.981096 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-c1d192c5-6671-418c-92c4-cd7b3f0a1dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19c9032b3e04003a81c0da1cec2a4ea'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:32.987469 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1427/2863] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:14:32 2021] DELETE /identity/v3/users/d19c9032b3e04003a81c0da1cec2a4ea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:14:33.171901 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:14:33.173366 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:14:33.190333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851070f-1721-4f05-bd48-87b3fb753a64 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:14:33.252694 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:14:33.253551 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:14:33.253828 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:14:33.254099 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] PATH_INFO: `/v3/projects/5b8ac2ec2ba941859063ce6f15001452` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:14:33.255333 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8ac2ec2ba941859063ce6f15001452)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:14:33.257249 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:14:33.308173 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8ac2ec2ba941859063ce6f15001452', 'request_id': 'req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:33.314476 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8ac2ec2ba941859063ce6f15001452', 'request_id': 'req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:33.323236 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8ac2ec2ba941859063ce6f15001452', 'request_id': 'req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:33.334851 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] The token cache is being invalidate because project 5b8ac2ec2ba941859063ce6f15001452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:14:33.335134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:33.335797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:14:33.337372 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1437/2864] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:14:33 2021] DELETE /identity/v3/projects/5b8ac2ec2ba941859063ce6f15001452 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:15:45.974375 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] REQUEST_METHOD: `POST` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:15:45.974994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:15:45.974994 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:15:45.992811 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.auth.core [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] MFA Rules not processed for user `913f4595b6444821801332dacab3c616`. Rule list: `[]` (Enabled: `True`). {{(pid=79109) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:15:45.994026 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:46.049472 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1428/2865] 10.222.0.57 () {58 vars in 957 bytes} [Wed Dec 15 13:15:45 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:15:46.361747 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:15:46.363204 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:46.417303 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c3903-f2aa-49aa-bd07-c0052f6dbd0f admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:15:46.420885 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:15:46.421519 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:15:46.421797 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:15:46.422071 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:15:46.423935 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:46.433180 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:15:46.434639 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:15:46.442360 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1438/2866] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:15:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:15:46.876071 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:15:46.877591 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:46.947204 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1126d-edaf-43c3-8881-673a44632590 None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:15:46.952654 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:15:46.953286 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:15:46.953572 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:15:46.953838 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:15:46.955666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:46.969105 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:15:46.970734 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:15:46.981416 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1429/2867] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:15:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:15:49.187134 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:15:49.190241 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:49.295787 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c031c3-2a20-4a5a-9473-0dfeb4941290 service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:15:49.301759 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:15:49.302437 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:15:49.302731 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:15:49.302983 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:15:49.305057 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:49.320389 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:15:49.322010 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:15:49.336461 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1439/2868] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:15:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 15 13:15:58.595845 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:15:58.597385 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:58.615710 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096e62e-dd9d-4384-9ab2-37d94c7ff5e4 service placement] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:15:58.621203 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b2623b20f16432d986a95fc400d52b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:15:58.621839 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:15:58.622123 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:15:58.622425 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:15:58.624299 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:15:58.636571 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:15:58.638136 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:15:58.649072 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1430/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:15:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:17:31.089877 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:17:31.127724 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af6d6d-6ed4-4852-971b-6f770869836b service nova] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:17:31.132106 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:17:31.132903 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:31.133185 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:31.133459 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:31.135310 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:17:31.170198 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:17:31.171660 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:17:31.180398 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1440/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:17:31 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:17:44.227209 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:17:44.228645 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:17:44.281092 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf7fac-a122-4997-9108-f23354c00488 service nova] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:17:44.284650 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6300d566628547b48cbe60769799c1bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:17:44.285280 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:44.285560 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:44.285832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:44.287605 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:17:44.378763 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:17:44.380770 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:17:44.398820 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1431/2871] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:17:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:17:50.760477 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:17:50.762576 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:17:50.779804 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b59707-27a2-4878-9309-6ce69d3b74ea service neutron] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:17:50.784399 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:17:50.785268 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:50.785547 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:50.785819 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] PATH_INFO: `/v3/users/913f4595b6444821801332dacab3c616` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:50.787846 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913f4595b6444821801332dacab3c616)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:17:50.789756 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:17:50.844974 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913f4595b6444821801332dacab3c616'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:50.852324 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913f4595b6444821801332dacab3c616'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:50.858881 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913f4595b6444821801332dacab3c616'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:50.859502 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913f4595b6444821801332dacab3c616'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:50.871092 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913f4595b6444821801332dacab3c616'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:50.876765 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1441/2872] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:17:50 2021] DELETE /identity/v3/users/913f4595b6444821801332dacab3c616 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:17:51.058170 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:17:51.068262 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605a140-7367-44ac-9028-2e0626c59142 service neutron] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:17:51.126276 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:17:51.127120 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:51.127396 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:51.127664 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] PATH_INFO: `/v3/projects/85b5372522d64067b34faa325b4dc400` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:51.128832 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b5372522d64067b34faa325b4dc400)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:17:51.130788 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:17:51.175087 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b5372522d64067b34faa325b4dc400', 'request_id': 'req-8e907b68-4776-48db-b10d-61c273c022b9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.181041 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b5372522d64067b34faa325b4dc400', 'request_id': 'req-8e907b68-4776-48db-b10d-61c273c022b9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.188242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b5372522d64067b34faa325b4dc400', 'request_id': 'req-8e907b68-4776-48db-b10d-61c273c022b9'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.198511 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] The token cache is being invalidate because project 85b5372522d64067b34faa325b4dc400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:17:51.198793 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.199414 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.201027 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1432/2873] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:17:51 2021] DELETE /identity/v3/projects/85b5372522d64067b34faa325b4dc400 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:17:51.205065 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:17:51.206541 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:17:51.220012 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5531f-a360-4f36-beeb-8cfc39378c71 admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:17:51.275305 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:17:51.276085 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:51.276363 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:51.276636 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] PATH_INFO: `/v3/users/ff750fad1f32481b983287f47b9931a7` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:51.277889 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff750fad1f32481b983287f47b9931a7)` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:17:51.280199 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:17:51.326284 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff750fad1f32481b983287f47b9931a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.334243 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff750fad1f32481b983287f47b9931a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.341355 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff750fad1f32481b983287f47b9931a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.342030 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff750fad1f32481b983287f47b9931a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.353991 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.notifications [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff750fad1f32481b983287f47b9931a7'} {{(pid=79110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.359967 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1442/2874] 10.222.0.57 () {58 vars in 1223 bytes} [Wed Dec 15 13:17:51 2021] DELETE /identity/v3/users/ff750fad1f32481b983287f47b9931a7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:17:51.531440 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:17:51.532926 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.fernet_utils [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79109) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:17:51.547173 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e907b68-4776-48db-b10d-61c273c022b9 admin admin] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:17:51.604757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad517a276964868864b69d91a8b9aea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce52653451e74d3f9f778f9e368425dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:17:51.605649 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:17:51.605924 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:17:51.606231 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] PATH_INFO: `/v3/projects/155236ceae63437faf4e20d49482f67d` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:17:51.607422 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155236ceae63437faf4e20d49482f67d)` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:17:51.609324 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:17:51.657338 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155236ceae63437faf4e20d49482f67d', 'request_id': 'req-6bb81f09-c3b3-4608-a62b-eea6f1766b96'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.663419 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155236ceae63437faf4e20d49482f67d', 'request_id': 'req-6bb81f09-c3b3-4608-a62b-eea6f1766b96'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.671039 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155236ceae63437faf4e20d49482f67d', 'request_id': 'req-6bb81f09-c3b3-4608-a62b-eea6f1766b96'} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.681327 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] The token cache is being invalidate because project 155236ceae63437faf4e20d49482f67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79109) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 15 13:17:51.681617 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.682322 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.notifications [None req-6bb81f09-c3b3-4608-a62b-eea6f1766b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79109) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 15 13:17:51.683893 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1433/2875] 10.222.0.57 () {58 vars in 1232 bytes} [Wed Dec 15 13:17:51 2021] DELETE /identity/v3/projects/155236ceae63437faf4e20d49482f67d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 15 13:18:14.698596 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Authenticating user token {{(pid=79110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:18:14.700000 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:14.785984 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f361-1784-48a4-9b09-96c87c614b3d admin admin] Validating token access rules against request {{(pid=79110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:18:14.847764 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:18:14.848408 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] REQUEST_METHOD: `GET` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:18:14.848691 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:18:14.848968 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:18:14.850768 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:18:14.861859 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:18:14.863480 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f164-8329-4235-8fc5-6174f3882918 service placement] RBAC: Authorization granted {{(pid=79110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:18:14.873345 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1443/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:18:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 15 13:23:19.690130 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360f64-5136-4520-8895-6fb60aef505e None None] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.690757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360f64-5136-4520-8895-6fb60aef505e None None] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.690757 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83360f64-5136-4520-8895-6fb60aef505e None None] PATH_INFO: `/` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:19.692515 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1434/2877] 10.222.0.57 () {54 vars in 960 bytes} [Wed Dec 15 13:23:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 15 13:23:19.698666 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cca54-36db-4b21-ba9e-a8ed9c82c735 None None] REQUEST_METHOD: `POST` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.699255 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cca54-36db-4b21-ba9e-a8ed9c82c735 None None] SCRIPT_NAME: `/identity` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.699424 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cca54-36db-4b21-ba9e-a8ed9c82c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:19.763156 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.auth.core [None req-377cca54-36db-4b21-ba9e-a8ed9c82c735 None None] MFA Rules not processed for user `b6e9b03e57d84f5f8dea7284ed1449f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 15 13:23:19.764377 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: DEBUG keystone.common.fernet_utils [None req-377cca54-36db-4b21-ba9e-a8ed9c82c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 15 13:23:19.773346 dv-cinder-813226-4-iscsi devstack@keystone.service[79110]: [pid: 79110|app: 0|req: 1444/2878] 10.222.0.57 () {58 vars in 1057 bytes} [Wed Dec 15 13:23:19 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 15 13:23:19.782236 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360f64-5136-4520-8895-6fb60aef505e None None] Authenticating user token {{(pid=79109) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 15 13:23:19.797666 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83360f64-5136-4520-8895-6fb60aef505e None None] Validating token access rules against request {{(pid=79109) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 15 13:23:19.803011 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560124d-5e3f-4334-bb7b-ddc7e2580681 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9b03e57d84f5f8dea7284ed1449f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98d37a74893744ea847160eb18f54c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79109) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 15 13:23:19.803691 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560124d-5e3f-4334-bb7b-ddc7e2580681 service placement] REQUEST_METHOD: `GET` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 15 13:23:19.803978 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560124d-5e3f-4334-bb7b-ddc7e2580681 service placement] SCRIPT_NAME: `/identity` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 15 13:23:19.804252 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560124d-5e3f-4334-bb7b-ddc7e2580681 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79109) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 15 13:23:19.814574 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560124d-5e3f-4334-bb7b-ddc7e2580681 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 15 13:23:19.816242 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560124d-5e3f-4334-bb7b-ddc7e2580681 service placement] RBAC: Authorization granted {{(pid=79109) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 15 13:23:19.827717 dv-cinder-813226-4-iscsi devstack@keystone.service[79109]: [pid: 79109|app: 0|req: 1435/2879] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Dec 15 13:23:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)